00000001:02000400:0.0F:1789042700.774342:0:2955:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg317-server.virtnet: executing set_hostid 00000001:02000400:0.0:1789042722.529826:0:3189:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local 00000001:01000000:0.0:1789042725.064477:0:3251:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 239 MB/s 00000001:01000000:2.0F:1789042725.315066:0:3251:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 247 MB/s 00000001:01000000:3.0F:1789042725.564661:0:3251:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 7519 MB/s 00000020:02000000:3.0:1789042726.607943:0:3281:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_2_g725efe4 00000400:02000000:1.0F:1789042728.578036:0:3296:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.117@tcp [8/256/0/180] 00008000:02000000:2.0:1789042734.080159:0:3446:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1789042794.351511:0:5250:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789042807.034439:0:5827:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789042807.034445:0:5827:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1789042807.034608:0:5827:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000005f7e93f0 00000080:02000400:0.0:1789042807.034618:0:5827:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1789042807.038927:0:5827:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1789042807.038942:0:5827:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789042807.038985:0:5827:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-osd (000000003e95e40f) 00000020:00000080:0.0:1789042807.039006:0:5827:0:(obd_config.c:786:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789042807.066598:0:5827:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1789042807.067305:0:5827:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1789042807.103861:0:5827:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789042807.103901:0:5827:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789042807.103922:0:5827:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789042807.103973:0:5827:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789042807.104000:0:5827:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789042807.104451:0:5827:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789042807.104460:0:5827:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789042807.104472:0:5827:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x99260d7389c05b96 00000020:01000004:3.0:1789042807.104479:0:5827:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1789042807.104483:0:5827:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789042807.104487:0:5827:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005f7e93f0 from MGS 00000020:01000004:3.0:1789042807.104491:0:5827:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789042807.104535:0:5827:0:(genops.c:415:class_newdev()) Allocate new device MGS (00000000fd245a35) 00000020:00000080:3.0:1789042807.104546:0:5827:0:(obd_config.c:786:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789042807.104701:0:5827:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005f7e93f0 from MGS, refs=2 00080000:01000000:3.0:1789042807.104706:0:5827:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789042807.104712:0:5827:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x99260d7389c05ba4 00000100:00100000:3.0:1789042807.104809:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789042807.104997:0:5827:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789042807.105003:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789042807.111018:0:5827:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789042807.111032:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789042807.113898:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789042807.114296:0:5827:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789042807.114304:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789042807.116404:0:5827:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789042807.116419:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789042807.116970:0:5827:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789042807.116977:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789042807.117923:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789042807.117927:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789042807.117929:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789042807.118401:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789042807.118410:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789042807.118412:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789042807.119165:0:5827:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789042807.122722:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1789042807.368620:0:5827:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4615 MB/s 00000001:01000000:3.0:1789042807.620951:0:5827:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2952 MB/s 00000001:01000000:3.0:1789042807.874736:0:5827:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 307 MB/s 00000001:01000000:1.0:1789042808.124891:0:5827:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 463 MB/s 00080000:10000000:1.0:1789042808.130992:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1789042808.148095:0:5827:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1789042808.148110:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789042808.148112:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1789042808.157940:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789042808.159247:0:5827:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789042808.159314:0:5827:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1789042808.159591:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789042808.159619:0:5827:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789042808.160215:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789042808.160394:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789042808.160400:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789042808.169204:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789042808.169217:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789042808.170184:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789042808.170194:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789042808.170776:0:5827:0:(obd_config.c:900:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789042808.170797:0:5827:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.117@tcp' 00000020:01000004:2.0:1789042808.170799:0:5827:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789042808.170855:0:5827:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.117@tcp (typ=mgc) 00000020:00000080:2.0:1789042808.170875:0:5827:0:(genops.c:415:class_newdev()) Allocate new device MGC192.168.203.117@tcp (00000000c0e11549) 00000020:00000080:2.0:1789042808.170893:0:5827:0:(obd_config.c:786:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789042808.171028:0:5827:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000550b4825@MGC192.168.203.117@tcp: add connection 192.168.203.117@tcp at head 00010000:00010000:2.0:1789042808.171187:0:5827:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.117@tcp-0 is initialized 00000040:01000000:2.0:1789042808.171193:0:5827:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.117@tcp ctxt 1 is initialized 00000100:00080000:1.0:1789042808.173602:0:5842:0:(pinger.c:501:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1789042808.178634:0:5844:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789042808.179372:0:5827:0:(obd_config.c:900:class_setup()) finished setup of obd MGC192.168.203.117@tcp (uuid 3de3a1ea-f793-48e7-82dd-f3f40cc922f9) 00000020:00000080:0.0:1789042808.179397:0:5827:0:(genops.c:1393:class_connect()) connect: client 3de3a1ea-f793-48e7-82dd-f3f40cc922f9, cookie 0x99260d7389c05bb2 00000100:00080000:0.0:1789042808.179410:0:5827:0:(import.c:545:import_select_connection()) MGC192.168.203.117@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789042808.179415:0:5827:0:(import.c:665:import_select_connection()) MGC192.168.203.117@tcp: import 00000000550b4825 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:0.0:1789042808.179460:0:5827:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ea5b1e58 x1875947267555456/t0(0) o250->MGC192.168.203.117@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789042808.179487:0:5827:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import 3de3a1ea-f793-48e7-82dd-f3f40cc922f9->MGS 00000020:01000004:0.0:1789042808.179505:0:5827:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789042808.179563:0:5827:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789042808.179579:0:5827:0:(genops.c:415:class_newdev()) Allocate new device MDS (00000000b130f04b) 00000020:00000080:0.0:1789042808.179592:0:5827:0:(obd_config.c:786:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00010000:00010000:3.0:1789042808.182870:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789042808.183084:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea5b1e58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3311:1875947267555456:0@lo:250: 00000100:00100000:1.0:1789042808.183188:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042808.183378:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267555456 00000100:00100000:3.0:1789042808.183387:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267555456 00000100:00100000:3.0:1789042808.183414:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789042808.183420:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a74d48f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3311:x1875947267555456:12345-0@lo:250: 00010000:00080000:3.0:1789042808.183443:0:5839:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 3de3a1ea-f793-48e7-82dd-f3f40cc922f9@0@lo t0 exp 0000000000000000 cur 151 last 0 00000020:00000080:3.0:1789042808.183467:0:5839:0:(genops.c:1393:class_connect()) connect: client 3de3a1ea-f793-48e7-82dd-f3f40cc922f9, cookie 0x99260d7389c05bc0 00000100:00080000:3.0:1789042808.199162:0:5839:0:(import.c:65:import_set_state_nolock()) 00000000517c4992 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789042808.199276:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a74d48f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+5:3311:x1875947267555456:12345-0@lo:250: Request processed in 15853us (16086us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042808.199287:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789042808.200482:0:3311:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.117@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789042808.200492:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.117@tcp: connect to target with instance 0 00000100:00080000:1.0:1789042808.200501:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.117@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789042808.200506:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789042808.200509:0:3311:0:(import.c:65:import_set_state_nolock()) 00000000550b4825 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789042808.200576:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789042808.201371:0:3311:0:(pinger.c:187:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789042808.201381:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea5b1e58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3311:1875947267555456:0@lo:250: 00000100:00100000:0.0:1789042808.206116:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789042808.206317:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789042808.206323:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789042808.211686:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789042808.211707:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789042808.214942:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789042808.214962:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789042808.215875:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789042808.216061:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789042808.216067:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789042808.217236:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789042808.217244:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789042808.280893:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789042808.281104:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789042808.281111:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789042808.282475:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789042808.282486:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789042808.283548:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789042808.283876:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789042808.283883:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789042808.284502:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789042808.284509:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789042808.285207:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789042808.285384:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789042808.285390:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789042808.286122:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789042808.286129:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789042808.287952:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789042808.288130:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789042808.288136:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789042808.303376:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789042808.303395:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789042808.409354:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789042808.411877:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789042808.411886:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789042808.414110:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789042808.414126:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789042808.422342:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789042808.422372:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789042808.423595:0:5827:0:(obd_config.c:900:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789042808.423618:0:5827:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1789042808.423624:0:5827:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.117@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789042808.423748:0:5827:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.117@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789042808.423777:0:5827:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.117@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1789042808.423781:0:5827:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789042808.423961:0:5827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789042808.423964:0:5827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789042808.423965:0:5827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789042808.423966:0:5827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789042808.423967:0:5827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789042808.423968:0:5827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789042808.423970:0:5827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789042808.423971:0:5827:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789042808.423972:0:5827:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789042808.423979:0:5827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789042808.423980:0:5827:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789042808.423982:0:5827:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1789042808.423984:0:5827:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789042808.423985:0:5827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789042808.423985:0:5827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789042808.423986:0:5827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789042808.423987:0:5827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789042808.423988:0:5827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789042808.423989:0:5827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789042808.423990:0:5827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789042808.423990:0:5827:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789042808.423991:0:5827:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789042808.423992:0:5827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789042808.423993:0:5827:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789042808.424027:0:5827:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789042808.424044:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000006b4d9bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5827:1875947267555584:0@lo:253: 00000100:00100000:2.0:1789042808.424200:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042808.424286:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a19361ee going to sleep for 11 seconds 00000100:00100000:1.0:1789042808.431733:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267555584 00000100:00100000:1.0:1789042808.431750:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267555584 00000100:00100000:1.0:1789042808.431865:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789042808.431891:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4c9c572 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+5:5827:x1875947267555584:12345-0@lo:253: 20000000:01000000:1.0:1789042808.431940:0:5841:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789042808.431943:0:5841:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1789042808.433976:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789042808.434228:0:5841:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1789042808.434545:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789042808.437429:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1789042808.437691:0:5841:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789042808.437695:0:5841:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1789042808.437701:0:5841:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1789042808.437704:0:5841:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1789042808.437719:0:5841:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1789042808.438096:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789042808.438332:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1789042808.438355:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789042808.438400:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1789042808.438450:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1789042808.438485:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1789042808.438606:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1789042808.438615:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1789042808.438656:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1789042808.438664:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1789042808.438695:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1789042808.438703:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1789042808.438731:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1789042808.438781:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1789042808.438835:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789042808.438840:0:5841:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1789042808.438855:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789042808.439691:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1789042808.439707:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789042808.439745:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1789042808.439774:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1789042808.440055:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1789042808.440130:0:5841:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1789042808.440215:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1789042808.440224:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789042808.440275:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1789042808.440307:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1789042808.440338:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1789042808.440362:0:5841:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1789042808.440452:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1789042808.440461:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1789042808.440492:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1789042808.440549:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1789042808.440735:0:5841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1789042808.441139:0:5841:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789042808.441149:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1789042808.445028:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1789042808.445476:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1789042808.445502:0:5841:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.117@tcp for mdt 20000000:01000000:1.0:1789042808.445505:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.117@tcp (null) (null) (null) 00000040:00080000:1.0:1789042808.445575:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1789042808.445584:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789042808.445614:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1789042808.445622:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.117@tcp (null) (null) 00000040:00080000:1.0:1789042808.445665:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1789042808.445675:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1789042808.445705:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1789042808.445748:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1789042808.446164:0:5841:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789042808.446167:0:5841:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789042808.446172:0:5841:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1789042808.446178:0:5841:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1789042808.447182:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:1.0:1789042808.447305:0:5841:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1789042808.460592:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1789042808.460651:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:1.0:1789042808.460777:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:1.0:1789042808.460798:0:5841:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789042808.460802:0:5841:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789042808.460807:0:5841:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789042808.461549:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789042808.461554:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789042808.461614:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789042808.461618:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789042808.463940:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1789042808.470587:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1789042808.470643:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1789042808.470681:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1789042808.470695:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789042808.470697:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789042808.471409:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:2.0:1789042808.471709:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:2.0:1789042808.471753:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:2.0:1789042808.471844:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:2.0:1789042808.471860:0:5841:0:(obd_config.c:1570:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789042808.471863:0:5841:0:(obd_config.c:1635:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:2.0:1789042808.472064:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789042808.472085:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000011945a24/0x99260d7389c05bc7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042808.472101:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000011945a24/0x99260d7389c05bc7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042808.472109:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000011945a24/0x99260d7389c05bc7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042808.472121:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000011945a24/0x99260d7389c05bc7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042808.472127:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000011945a24/0x99260d7389c05bc7 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042808.472134:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000011945a24/0x99260d7389c05bc7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042808.472139:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000011945a24 already unused, calling callback (00000000a8e9cfc1) 00010000:00010000:2.0:1789042808.472143:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000011945a24/0x99260d7389c05bc7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042808.472150:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000011945a24/0x99260d7389c05bc7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042808.472162:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000011945a24/0x99260d7389c05bc7 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042808.472168:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000011945a24/0x99260d7389c05bc7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042808.472174:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000011945a24/0x99260d7389c05bc7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789042808.472190:0:5841:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789042808.904956:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4c9c572 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+5:5827:x1875947267555584:12345-0@lo:253: Request processed in 473062us (480751us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042808.904972:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789042808.905138:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000006b4d9bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5827:1875947267555584:0@lo:253: 10000000:01000000:2.0:1789042808.905154:0:5827:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789042808.905157:0:5827:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789042808.905159:0:5827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789042808.905175:0:5827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789042808.905176:0:5827:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1789042808.905177:0:5827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789042808.905179:0:5827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789042808.905180:0:5827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789042808.905181:0:5827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789042808.905183:0:5827:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789042808.905184:0:5827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789042808.905186:0:5827:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789042808.905203:0:5827:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005f7e93f0 from lustre-MDT0000 10000000:01000000:2.0:1789042808.905227:0:5827:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789042808.905229:0:5827:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789042808.905233:0:5827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffffa06a5209cd88 10000000:01000000:2.0:1789042808.905237:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789042808.905244:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffffa06a5209cd88 from 1 10000000:01000000:2.0:1789042808.905247:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789042808.905282:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: 0000000011945a24/0x99260d7389c05bce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042808.905291:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: 0000000011945a24/0x99260d7389c05bce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042808.905299:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: 0000000011945a24/0x99260d7389c05bce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042808.905316:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000006b4d9bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5827:1875947267555712:0@lo:101: 00000100:00100000:2.0:1789042808.905362:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042808.905419:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 000000005e980c01 going to sleep for 11 seconds 00000100:00100000:3.0:1789042808.905574:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267555712 00000100:00100000:3.0:1789042808.905582:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267555712 00000100:00100000:3.0:1789042808.905623:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789042808.905631:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b7c980e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+5:5827:x1875947267555712:12345-0@lo:101: 00010000:00010000:3.0:1789042808.905643:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789042808.905657:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f3af6e5c/0x99260d7389c05bd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05bce expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042808.905689:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f3af6e5c/0x99260d7389c05bd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05bce expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042808.905698:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f3af6e5c/0x99260d7389c05bd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05bce expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042808.905706:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f3af6e5c, rc 0) 00000100:00100000:3.0:1789042808.905740:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b7c980e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+6:5827:x1875947267555712:12345-0@lo:101: Request processed in 111us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042808.905746:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789042808.906149:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000006b4d9bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5827:1875947267555712:0@lo:101: 00010000:00010000:0.0:1789042808.906163:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: 0000000011945a24/0x99260d7389c05bce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05bd5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042808.906172:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: 0000000011945a24/0x99260d7389c05bce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05bd5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042808.906221:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c5567144 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5827:1875947267555840:0@lo:501: 00000100:00100000:0.0:1789042808.906248:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042808.906282:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bbc6a293 going to sleep for 11 seconds 00000100:00100000:3.0:1789042808.906395:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267555840 00000100:00100000:3.0:1789042808.906401:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267555840 00000100:00100000:3.0:1789042808.906429:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789042808.906436:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ece5a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+6:5827:x1875947267555840:12345-0@lo:501: 00000100:00100000:3.0:1789042808.906675:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ece5a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+6:5827:x1875947267555840:12345-0@lo:501: Request processed in 239us (425us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789042808.906682:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789042808.906791:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c5567144 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5827:1875947267555840:0@lo:501: 10000000:01000000:0.0:1789042808.906815:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789042808.906969:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: 0000000011945a24/0x99260d7389c05bce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05bd5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042808.906987:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: 0000000011945a24/0x99260d7389c05bce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05bd5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789042808.906996:0:5827:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa06a52b8e800 10000000:01000000:0.0:1789042808.907000:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789042808.907004:0:5827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffffa06a52b8e800 10000000:01000000:0.0:1789042808.907006:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789042808.907009:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffffa06a52b8e800 from 1 10000000:01000000:0.0:1789042808.907011:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789042808.907031:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: 000000006dcf6307/0x99260d7389c05bdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042808.907037:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: 000000006dcf6307/0x99260d7389c05bdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042808.907046:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: 000000006dcf6307/0x99260d7389c05bdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042808.907057:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c5567144 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5827:1875947267555968:0@lo:101: 00000100:00100000:0.0:1789042808.907083:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042808.907110:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bbc6a293 going to sleep for 11 seconds 00000100:00100000:2.0:1789042808.907175:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267555968 00000100:00100000:2.0:1789042808.907181:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267555968 00000100:00100000:2.0:1789042808.907214:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789042808.907220:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008fe5251d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+6:5827:x1875947267555968:12345-0@lo:101: 00010000:00010000:2.0:1789042808.907229:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789042808.907245:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000059efe46d/0x99260d7389c05be3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05bdc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042808.907262:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000059efe46d/0x99260d7389c05be3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05bdc expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042808.907271:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000059efe46d/0x99260d7389c05be3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05bdc expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042808.907278:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000059efe46d, rc 0) 00000100:00100000:2.0:1789042808.907312:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008fe5251d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+7:5827:x1875947267555968:12345-0@lo:101: Request processed in 92us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042808.907319:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789042808.907431:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c5567144 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5827:1875947267555968:0@lo:101: 00010000:00010000:0.0:1789042808.907442:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: 000000006dcf6307/0x99260d7389c05bdc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05be3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042808.907448:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: 000000006dcf6307/0x99260d7389c05bdc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05be3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789042808.907470:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789042808.907474:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: 000000006dcf6307/0x99260d7389c05bdc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05be3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042808.907479:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: 000000006dcf6307/0x99260d7389c05bdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05be3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789042808.907485:0:5827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789042808.907489:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789042808.907492:0:5827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffffa06a52b8e800 10000000:01000000:0.0:1789042808.907494:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789042808.907497:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789042808.907499:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789042808.907511:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: 00000000b31bbdeb/0x99260d7389c05bea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042808.907602:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: 00000000b31bbdeb/0x99260d7389c05bea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042808.907608:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: 00000000b31bbdeb/0x99260d7389c05bea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042808.915916:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c5567144 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5827:1875947267556096:0@lo:101: 00000100:00100000:2.0:1789042808.915996:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042808.916187:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 0000000098ee508d going to sleep for 11 seconds 00000100:00100000:1.0:1789042808.927904:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267556096 00000100:00100000:1.0:1789042808.927920:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267556096 00000100:00100000:1.0:1789042808.927992:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789042808.928001:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5f518e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+7:5827:x1875947267556096:12345-0@lo:101: 00010000:00010000:1.0:1789042808.928017:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789042808.928036:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000000504581/0x99260d7389c05bf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05bea expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042808.928082:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000000504581/0x99260d7389c05bf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05bea expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042808.928092:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000000504581/0x99260d7389c05bf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05bea expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042808.928101:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000000504581, rc 0) 00000100:00100000:1.0:1789042808.928186:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5f518e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+8:5827:x1875947267556096:12345-0@lo:101: Request processed in 186us (12190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042808.928193:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789042808.928718:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c5567144 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5827:1875947267556096:0@lo:101: 00010000:00010000:3.0:1789042808.928737:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: 00000000b31bbdeb/0x99260d7389c05bea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05bf1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042808.928747:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: 00000000b31bbdeb/0x99260d7389c05bea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05bf1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042808.928824:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009a558bd3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5827:1875947267556224:0@lo:501: 00000100:00100000:3.0:1789042808.928859:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042808.928915:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 00000000952563db going to sleep for 11 seconds 00000100:00100000:1.0:1789042808.929027:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267556224 00000100:00100000:1.0:1789042808.929033:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267556224 00000100:00100000:1.0:1789042808.929068:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789042808.929075:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c779f1f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+8:5827:x1875947267556224:12345-0@lo:501: 00000100:00100000:1.0:1789042808.929315:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c779f1f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+9:5827:x1875947267556224:12345-0@lo:501: Request processed in 241us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042808.929323:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789042808.929408:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009a558bd3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5827:1875947267556224:0@lo:501: 00000100:00100000:2.0:1789042808.929442:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022869ffc pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5827:1875947267556352:0@lo:503: 00000100:00100000:2.0:1789042808.929479:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042808.929501:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bbc1b4dc going to sleep for 11 seconds 00000100:00100000:0.0:1789042808.929577:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267556352 00000100:00100000:0.0:1789042808.929582:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267556352 00000100:00100000:0.0:1789042808.929611:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789042808.929618:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6789598 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+9:5827:x1875947267556352:12345-0@lo:503: 00000100:00100000:0.0:1789042808.929781:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6789598 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+9:5827:x1875947267556352:12345-0@lo:503: Request processed in 164us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042808.929798:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789042808.929916:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022869ffc pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5827:1875947267556352:0@lo:503: 00000100:00100000:2.0:1789042808.930355:0:5868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022869ffc pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5868:1875947267556480:0@lo:502: 00000100:00100000:2.0:1789042808.930390:0:5868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042808.930419:0:5868:0:(client.c:2716:ptlrpc_set_wait()) set 0000000045309b3e going to sleep for 11 seconds 00000100:00100000:0.0:1789042808.930467:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267556480 00000100:00100000:0.0:1789042808.930472:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267556480 00000100:00100000:0.0:1789042808.930490:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789042808.930496:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000093b351f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+9:5868:x1875947267556480:12345-0@lo:502: 00000100:00100000:0.0:1789042808.930664:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000093b351f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+9:5868:x1875947267556480:12345-0@lo:502: Request processed in 168us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042808.930671:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789042808.930788:0:5868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022869ffc pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5868:1875947267556480:0@lo:502: 00000020:01000000:2.0:1789042808.930809:0:5868:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789042808.930819:0:5868:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789042808.930826:0:5868:0:(obd_config.c:1661:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789042808.930831:0:5868:0:(obd_config.c:2065:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789042808.930834:0:5868:0:(obd_config.c:1570:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789042808.930847:0:5868:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000007e9a097a) 00000020:00000080:2.0:1789042808.930862:0:5868:0:(obd_config.c:786:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789042808.930879:0:5868:0:(obd_config.c:1570:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789042808.930940:0:5868:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789042808.930947:0:5868:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x99260d7389c05bff 00000020:00000080:2.0:1789042808.931162:0:5868:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789042808.931166:0:5868:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789042808.931170:0:5868:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789042808.931172:0:5868:0:(obd_config.c:1661:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789042808.931174:0:5868:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789042808.931178:0:5868:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789042808.931179:0:5868:0:(obd_config.c:1661:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789042808.931182:0:5868:0:(obd_config.c:1570:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789042808.931189:0:5868:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000 (000000004d52aed5) 00000020:00000080:2.0:1789042808.931199:0:5868:0:(obd_config.c:786:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789042808.931202:0:5868:0:(obd_config.c:1570:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789042808.931204:0:5868:0:(obd_config.c:1614:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789042808.931206:0:5868:0:(obd_config.c:1247:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789042808.931212:0:5868:0:(obd_config.c:1570:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789042808.931257:0:5868:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005f7e93f0 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789042808.931271:0:5868:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDD0000 (00000000f1048787) 00000020:00000080:2.0:1789042808.931280:0:5868:0:(obd_config.c:786:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789042808.931335:0:5868:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789042808.931350:0:5868:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x99260d7389c05c14 00000020:00000080:2.0:1789042808.931438:0:5868:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789042808.931444:0:5868:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789042808.931449:0:5868:0:(genops.c:1393:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x99260d7389c05c1b 00080000:01000000:2.0:1789042808.931453:0:5868:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789042808.931457:0:5868:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x99260d7389c05c22 00080000:10000000:2.0:1789042808.931838:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1789042808.932060:0:5868:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1789042808.938314:0:5868:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1789042809.083178:0:5868:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1789042809.083952:0:5868:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1789042809.086841:0:5868:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1789042809.087329:0:5868:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789042809.157322:0:5868:0:(genops.c:415:class_newdev()) Allocate new device lustre-QMT0000 (0000000057e8a851) 00000020:00000080:1.0:1789042809.157356:0:5868:0:(obd_config.c:786:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789042809.157430:0:5868:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789042809.157439:0:5868:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x99260d7389c05c30 00000020:00000080:2.0:1789042809.171546:0:5868:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1789042809.176543:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00010000:00010000:3.0:1789042809.203762:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1789042809.299383:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789042809.338318:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789042809.413368:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789042809.460605:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789042809.563326:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1789042809.612661:0:5868:0:(genops.c:1393:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x99260d7389c05c37 00000020:00000080:0.0:1789042809.613087:0:5868:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789042809.613098:0:5868:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789042809.613104:0:5868:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789042809.613107:0:5868:0:(obd_config.c:1661:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789042809.613110:0:5868:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789042809.613117:0:5868:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789042809.613118:0:5868:0:(obd_config.c:1661:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789042809.613122:0:5868:0:(obd_config.c:1570:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789042809.613247:0:5868:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789042809.613262:0:5868:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789042809.613266:0:5868:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789042809.613267:0:5868:0:(obd_config.c:1661:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1789042809.613269:0:5868:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789042809.613272:0:5868:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789042809.613273:0:5868:0:(obd_config.c:1661:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789042809.613276:0:5868:0:(obd_config.c:1570:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789042809.613278:0:5868:0:(obd_config.c:1635:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789042809.613318:0:5868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b9d1eb4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5868:1875947267556608:0@lo:502: 00000100:00100000:0.0:1789042809.613407:0:5868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042809.613460:0:5868:0:(client.c:2716:ptlrpc_set_wait()) set 000000007c04d094 going to sleep for 11 seconds 00000100:00100000:1.0:1789042809.613575:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267556608 00000100:00100000:1.0:1789042809.613582:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267556608 00000100:00100000:1.0:1789042809.613632:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789042809.613639:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008171eaf4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+9:5868:x1875947267556608:12345-0@lo:502: 00000100:00100000:1.0:1789042809.616426:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008171eaf4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+9:5868:x1875947267556608:12345-0@lo:502: Request processed in 2781us (3012us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042809.616440:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789042809.619116:0:5868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b9d1eb4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5868:1875947267556608:0@lo:502: 00000020:01000000:2.0:1789042809.619164:0:5868:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789042809.619175:0:5868:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789042809.619177:0:5868:0:(obd_config.c:1661:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789042809.619181:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1789042809.619500:0:5827:0:(obd_config.c:2243:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1789042809.619537:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789042809.619556:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: 00000000b31bbdeb/0x99260d7389c05bea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05bf1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042809.619568:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: 00000000b31bbdeb/0x99260d7389c05bea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05bf1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789042809.619575:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa06a52b8e800 from 1 10000000:01000000:0.0:1789042809.619578:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789042809.619608:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: 00000000892d4a5e/0x99260d7389c05c3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042809.619616:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: 00000000892d4a5e/0x99260d7389c05c3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042809.619625:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: 00000000892d4a5e/0x99260d7389c05c3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042809.619642:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ead13969 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5827:1875947267556736:0@lo:101: 00000100:00100000:0.0:1789042809.619699:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042809.619752:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fc64d786 going to sleep for 11 seconds 00000100:00100000:1.0:1789042809.619864:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267556736 00000100:00100000:1.0:1789042809.619881:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267556736 00000100:00100000:1.0:1789042809.619925:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789042809.619932:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f04ddd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+9:5827:x1875947267556736:12345-0@lo:101: 00010000:00010000:1.0:1789042809.619944:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789042809.619955:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003c5ba104/0x99260d7389c05c45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05c3e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042809.619974:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003c5ba104/0x99260d7389c05c45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05c3e expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042809.619984:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003c5ba104/0x99260d7389c05c45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05c3e expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042809.619991:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003c5ba104, rc 0) 00000100:00100000:1.0:1789042809.620030:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f04ddd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+10:5827:x1875947267556736:12345-0@lo:101: Request processed in 98us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042809.620036:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789042809.620172:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ead13969 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5827:1875947267556736:0@lo:101: 00010000:00010000:2.0:1789042809.620185:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: 00000000892d4a5e/0x99260d7389c05c3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05c45 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042809.620192:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: 00000000892d4a5e/0x99260d7389c05c3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05c45 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042809.620711:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022869ffc pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5827:1875947267556864:0@lo:256: 00000100:00100000:2.0:1789042809.620751:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042809.620772:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 000000002fa1068f going to sleep for 11 seconds 00000100:00100000:1.0:1789042809.620881:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267556864 00000100:00100000:1.0:1789042809.620887:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267556864 00000100:00100000:1.0:1789042809.620919:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789042809.620926:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c32afcd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+10:5827:x1875947267556864:12345-0@lo:256: 20000000:01000000:1.0:1789042809.620940:0:5840:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789042809.620945:0:5840:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789042809.621013:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c32afcd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+10:5827:x1875947267556864:12345-0@lo:256: Request processed in 88us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042809.621026:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789042809.621309:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022869ffc pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5827:1875947267556864:0@lo:256: 10000000:01000000:2.0:1789042809.621847:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789042809.623708:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: 00000000892d4a5e/0x99260d7389c05c3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05c45 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042809.623726:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: 00000000892d4a5e/0x99260d7389c05c3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05c45 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789042809.627241:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa06a52b8e800 from 1 10000000:01000000:2.0:1789042809.627245:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789042809.627288:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: 00000000b81c6b0c/0x99260d7389c05c4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042809.627296:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: 00000000b81c6b0c/0x99260d7389c05c4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042809.627305:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: 00000000b81c6b0c/0x99260d7389c05c4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042809.627326:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022869ffc pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5827:1875947267556992:0@lo:101: 00000100:00100000:2.0:1789042809.627403:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042809.627442:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 000000002fa1068f going to sleep for 11 seconds 00000100:00100000:1.0:1789042809.627864:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267556992 00000100:00100000:1.0:1789042809.627881:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267556992 00000100:00100000:1.0:1789042809.627931:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789042809.627938:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000858acc27 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+10:5827:x1875947267556992:12345-0@lo:101: 00010000:00010000:1.0:1789042809.627950:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789042809.627963:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b83454fd/0x99260d7389c05c53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05c4c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042809.627984:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b83454fd/0x99260d7389c05c53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05c4c expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042809.627993:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b83454fd/0x99260d7389c05c53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05c4c expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042809.628001:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b83454fd, rc 0) 00000100:00100000:1.0:1789042809.628049:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000858acc27 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+11:5827:x1875947267556992:12345-0@lo:101: Request processed in 112us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042809.628056:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789042809.628257:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022869ffc pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5827:1875947267556992:0@lo:101: 00010000:00010000:2.0:1789042809.628272:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: 00000000b81c6b0c/0x99260d7389c05c4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05c53 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042809.628281:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: 00000000b81c6b0c/0x99260d7389c05c4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05c53 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042809.628334:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022869ffc pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5827:1875947267557120:0@lo:501: 00000100:00100000:2.0:1789042809.628374:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042809.628402:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 000000002fa1068f going to sleep for 11 seconds 00000100:00100000:0.0:1789042809.628455:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267557120 00000100:00100000:0.0:1789042809.628460:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267557120 00000100:00100000:0.0:1789042809.628490:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789042809.628497:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008cf16c10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+11:5827:x1875947267557120:12345-0@lo:501: 00000100:00100000:0.0:1789042809.628933:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008cf16c10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+11:5827:x1875947267557120:12345-0@lo:501: Request processed in 436us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042809.628949:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789042809.629310:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022869ffc pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5827:1875947267557120:0@lo:501: 00000100:00100000:2.0:1789042809.629359:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022869ffc pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5827:1875947267557248:0@lo:503: 00000100:00100000:2.0:1789042809.629410:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042809.629442:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 000000002fa1068f going to sleep for 11 seconds 00000100:00100000:0.0:1789042809.629492:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267557248 00000100:00100000:0.0:1789042809.629499:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267557248 00000100:00100000:0.0:1789042809.629555:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789042809.629562:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004995b066 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+11:5827:x1875947267557248:12345-0@lo:503: 00000040:00080000:0.0:1789042809.629601:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789042809.629635:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004995b066 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+11:5827:x1875947267557248:12345-0@lo:503: Request processed in 75us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042809.629642:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789042809.629724:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022869ffc pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5827:1875947267557248:0@lo:503: 00000040:00080000:1.0:1789042809.631445:0:5872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1789042809.631737:0:5827:0:(obd_config.c:2243:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1789042809.631760:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789042809.631770:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: 00000000b81c6b0c/0x99260d7389c05c4c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05c53 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042809.631784:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: 00000000b81c6b0c/0x99260d7389c05c4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05c53 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789042809.633380:0:5827:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789042809.633388:0:5827:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa06a52b8e800 10000000:01000000:2.0:1789042809.633391:0:5827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa06a52b8e800 10000000:01000000:2.0:1789042809.633395:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789042809.633402:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa06a52b8e800 from 1 10000000:01000000:2.0:1789042809.633405:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789042809.633441:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: 00000000fdc2da61/0x99260d7389c05c5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042809.633453:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: 00000000fdc2da61/0x99260d7389c05c5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042809.633463:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: 00000000fdc2da61/0x99260d7389c05c5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042809.633485:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022869ffc pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5827:1875947267557376:0@lo:101: 00000100:00100000:2.0:1789042809.633567:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042809.633604:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 0000000037f1e538 going to sleep for 11 seconds 00000100:00100000:3.0:1789042809.633771:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267557376 00000100:00100000:3.0:1789042809.633779:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267557376 00000100:00100000:3.0:1789042809.633834:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789042809.633842:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000073d27514 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+11:5827:x1875947267557376:12345-0@lo:101: 00010000:00010000:3.0:1789042809.633854:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789042809.633865:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001314f85f/0x99260d7389c05c61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05c5a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042809.633900:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001314f85f/0x99260d7389c05c61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05c5a expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042809.633909:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001314f85f/0x99260d7389c05c61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05c5a expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042809.633916:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001314f85f, rc 0) 00000100:00100000:3.0:1789042809.633964:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000073d27514 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:5827:x1875947267557376:12345-0@lo:101: Request processed in 123us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042809.633970:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789042809.634148:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022869ffc pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5827:1875947267557376:0@lo:101: 00010000:00010000:0.0:1789042809.634163:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: 00000000fdc2da61/0x99260d7389c05c5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05c61 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042809.634171:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: 00000000fdc2da61/0x99260d7389c05c5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05c61 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042809.634219:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005694d392 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5827:1875947267557504:0@lo:501: 00000100:00100000:0.0:1789042809.634244:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042809.634263:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fc64d786 going to sleep for 11 seconds 00000100:00100000:1.0:1789042809.634401:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267557504 00000100:00100000:1.0:1789042809.634407:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267557504 00000100:00100000:1.0:1789042809.634437:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789042809.634444:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fdd998e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:5827:x1875947267557504:12345-0@lo:501: 00000100:00100000:0.0:1789042809.636296:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fdd998e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:5827:x1875947267557504:12345-0@lo:501: Request processed in 1848us (2046us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042809.636308:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789042809.638570:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005694d392 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5827:1875947267557504:0@lo:501: 00000100:00100000:2.0:1789042809.638649:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c9f6115f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5827:1875947267557632:0@lo:503: 00000100:00100000:2.0:1789042809.638716:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042809.638755:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 0000000076a7cb96 going to sleep for 11 seconds 00000100:00100000:0.0:1789042809.638951:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267557632 00000100:00100000:0.0:1789042809.638959:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267557632 00000100:00100000:0.0:1789042809.639007:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789042809.639016:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a73c690 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:5827:x1875947267557632:12345-0@lo:503: 00000100:00100000:0.0:1789042809.639234:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a73c690 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:5827:x1875947267557632:12345-0@lo:503: Request processed in 219us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042809.639248:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789042809.639414:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c9f6115f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5827:1875947267557632:0@lo:503: 00000100:00100000:2.0:1789042809.640888:0:5873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c9f6115f pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5873:1875947267557760:0@lo:502: 00000100:00100000:2.0:1789042809.640951:0:5873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042809.640987:0:5873:0:(client.c:2716:ptlrpc_set_wait()) set 0000000051e6b54f going to sleep for 11 seconds 00000100:00100000:0.0:1789042809.641107:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267557760 00000100:00100000:0.0:1789042809.641115:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267557760 00000100:00100000:0.0:1789042809.641158:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789042809.641165:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2016adf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:5873:x1875947267557760:12345-0@lo:502: 00000100:00100000:0.0:1789042809.641410:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2016adf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:5873:x1875947267557760:12345-0@lo:502: Request processed in 244us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042809.641417:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789042809.641496:0:5873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c9f6115f pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5873:1875947267557760:0@lo:502: 00000020:01000004:1.0:1789042809.641582:0:5873:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789042809.641595:0:5873:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000c0e39b57) 00000020:00000080:1.0:1789042809.641618:0:5873:0:(obd_config.c:786:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1789042809.641699:0:5873:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005f7e93f0 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789042809.641703:0:5873:0:(tgt_mount.c:187:server_put_mount()) put mount 000000005f7e93f0 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789042809.641706:0:5873:0:(obd_mount.c:710:lustre_put_lsi()) put 000000005f7e93f0 4 00010000:00080000:1.0:1789042809.641732:0:5873:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000029c7f185@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.117@tcp at head 00010000:00010000:1.0:1789042809.643652:0:5873:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1789042809.644416:0:5873:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789042809.644451:0:5873:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789042809.644461:0:5873:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x99260d7389c05c6f 00000100:00080000:1.0:1789042809.644471:0:5873:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789042809.644476:0:5873:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000029c7f185 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:1.0:1789042809.644722:0:5873:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007927c3b6 x1875947267557888/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789042809.644773:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007927c3b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875947267557888:0@lo:38: 00000100:00100000:0.0:1789042809.644861:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042809.645089:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267557888 00000100:00100000:2.0:1789042809.645098:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267557888 00000100:00100000:2.0:1789042809.645130:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789042809.645137:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3ddae4b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1875947267557888:12345-0@lo:38: 00000100:00080000:1.0:1789042809.645351:0:5873:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789042809.651060:0:5873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006de630b9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5873:1875947267558016:0@lo:502: 00000100:00100000:3.0:1789042809.651140:0:5873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042809.651179:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267558016 00000100:00100000:3.0:1789042809.651186:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267558016 00000100:00100000:3.0:1789042809.651227:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789042809.651234:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dbdcaec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:5873:x1875947267558016:12345-0@lo:502: 00000100:00100000:3.0:1789042809.651448:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dbdcaec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:5873:x1875947267558016:12345-0@lo:502: Request processed in 213us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042809.651464:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789042809.651648:0:5873:0:(client.c:2716:ptlrpc_set_wait()) set 000000007e203102 going to sleep for 11 seconds 00000100:00100000:3.0:1789042809.651669:0:5873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006de630b9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5873:1875947267558016:0@lo:502: 00000040:00080000:3.0:1789042809.651693:0:5873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:2.0:1789042809.654150:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3ddae4b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1875947267557888:12345-0@lo:38: Request processed in 9005us (9282us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789042809.654164:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789042809.654277:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789042809.654285:0:3311:0:(import.c:65:import_set_state_nolock()) 0000000029c7f185 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789042809.654289:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789042809.654292:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007927c3b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875947267557888:0@lo:38: 00000020:01000000:0.0:1789042809.654323:0:5827:0:(obd_config.c:2243:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1789042809.654358:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789042809.654379:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: 00000000fdc2da61/0x99260d7389c05c5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05c61 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042809.654389:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: 00000000fdc2da61/0x99260d7389c05c5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05c61 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789042809.654443:0:5827:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789042809.654445:0:5827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789042809.654447:0:5827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789042809.654447:0:5827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789042809.654448:0:5827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789042809.654450:0:5827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789042809.654455:0:5827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789042809.654456:0:5827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789042809.654458:0:5827:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789042809.654459:0:5827:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789042809.654460:0:5827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789042809.654461:0:5827:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789042809.654464:0:5827:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1789042809.654466:0:5827:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789042809.654467:0:5827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789042809.654468:0:5827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789042809.654469:0:5827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789042809.654469:0:5827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789042809.654470:0:5827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789042809.654471:0:5827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789042809.654472:0:5827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789042809.654473:0:5827:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789042809.654473:0:5827:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789042809.654474:0:5827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789042809.654475:0:5827:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789042809.654494:0:5827:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789042809.654506:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006ed94709 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5827:1875947267558144:0@lo:253: 00000100:00100000:0.0:1789042809.654575:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042809.654610:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e4d62c50 going to sleep for 11 seconds 00000100:00100000:1.0:1789042809.655113:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267558144 00000100:00100000:1.0:1789042809.655121:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267558144 00000100:00100000:1.0:1789042809.655198:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789042809.655207:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a1be02f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:5827:x1875947267558144:12345-0@lo:253: 20000000:01000000:1.0:1789042809.655231:0:5841:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789042809.655244:0:5841:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789042809.751903:0:5841:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789042809.751924:0:5841:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789042809.751979:0:5861:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789042809.751985:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789042809.752004:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009856703d/0x99260d7389c05c76 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042809.752022:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003c5ba104/0x99260d7389c05c45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05c3e expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042809.752031:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000009856703d/0x99260d7389c05c76 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042809.752068:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003c5ba104/0x99260d7389c05c45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99260d7389c05c3e expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042809.752096:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003c5ba104/0x99260d7389c05c45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99260d7389c05c3e expref: 12 pid: 5839 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042809.752110:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d77e534b pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1875947267558272:0@lo:104: 00000100:00100000:2.0:1789042809.752168:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042809.752232:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set 000000002b484e5b going to sleep for 11 seconds 00000100:00100000:0.0:1789042809.753055:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267558272 00000100:00100000:0.0:1789042809.753066:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267558272 00000100:00100000:0.0:1789042809.753121:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789042809.753130:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000bd65031 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+3:5861:x1875947267558272:12345-0@lo:104: 00010000:00010000:0.0:1789042809.753144:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: 00000000892d4a5e/0x99260d7389c05c3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05c45 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042809.753213:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789042809.753218:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000bd65031 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+3:5861:x1875947267558272:12345-0@lo:104: Request processed in 90us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042809.753236:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789042809.753256:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789042809.753257:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d77e534b pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1875947267558272:0@lo:104: 00010000:00010000:0.0:1789042809.753260:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: 00000000892d4a5e/0x99260d7389c05c3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05c45 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042809.753267:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000892d4a5e already unused, calling callback (00000000776f8733) 10000000:00010000:0.0:1789042809.753269:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: 00000000892d4a5e/0x99260d7389c05c3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x99260d7389c05c45 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042809.753275:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000009856703d/0x99260d7389c05c76 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042809.753276:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: 00000000892d4a5e/0x99260d7389c05c3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x99260d7389c05c45 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789042809.753283:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: 00000000892d4a5e/0x99260d7389c05c3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x99260d7389c05c45 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789042809.753289:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789042809.753314:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: 00000000892d4a5e/0x99260d7389c05c3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05c45 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042809.753320:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789042809.753348:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: 00000000892d4a5e/0x99260d7389c05c3e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05c45 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042809.753355:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: 00000000892d4a5e/0x99260d7389c05c3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05c45 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042809.753586:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000084dcff49 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267558400:0@lo:103: 00000100:00100000:0.0:1789042809.753619:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042809.753699:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267558400 00000100:00100000:0.0:1789042809.753707:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267558400 00010000:00010000:0.0:1789042809.753721:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003c5ba104/0x99260d7389c05c45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05c3e expref: 13 pid: 5839 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042809.753748:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789042809.753754:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000638058f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:3313:x1875947267558400:12345-0@lo:103: 00010000:00010000:0.0:1789042809.753770:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789042809.753774:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003c5ba104/0x99260d7389c05c45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05c3e expref: 13 pid: 5839 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042809.753783:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003c5ba104/0x99260d7389c05c45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99260d7389c05c3e expref: 13 pid: 5839 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042809.753795:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003c5ba104/0x99260d7389c05c45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99260d7389c05c3e expref: 13 pid: 5839 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042809.753808:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000009856703d/0x99260d7389c05c76 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042809.753821:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009856703d/0x99260d7389c05c76 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789042809.753833:0:5831:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001849099s 00010000:00010000:0.0:1789042809.753837:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009856703d/0x99260d7389c05c76 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042809.753843:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009856703d/0x99260d7389c05c76 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042809.753849:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009856703d/0x99260d7389c05c76 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042809.753863:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009856703d/0x99260d7389c05c76 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042809.753878:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009856703d already unused, calling callback (00000000a8e9cfc1) 00010000:00010000:0.0:1789042809.753881:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009856703d/0x99260d7389c05c76 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042809.753888:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009856703d/0x99260d7389c05c76 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042809.753903:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009856703d/0x99260d7389c05c76 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042809.753912:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789042809.753937:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000638058f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:3313:x1875947267558400:12345-0@lo:103: Request processed in 184us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042809.753943:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789042809.753962:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789042809.753964:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789042809.753965:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789042809.753976:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000084dcff49 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267558400:0@lo:103: 00010000:00010000:3.0:1789042809.754328:0:5861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000009856703d/0x99260d7389c05c76 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042809.754347:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009856703d/0x99260d7389c05c76 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042809.754353:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009856703d/0x99260d7389c05c76 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042809.765065:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a1be02f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+11:5827:x1875947267558144:12345-0@lo:253: Request processed in 109852us (110483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042809.765080:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789042809.766388:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006ed94709 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5827:1875947267558144:0@lo:253: 10000000:01000000:0.0:1789042809.766408:0:5827:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789042809.766411:0:5827:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789042809.766413:0:5827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789042809.766414:0:5827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789042809.766415:0:5827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789042809.766416:0:5827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789042809.766418:0:5827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789042809.766434:0:5827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789042809.766435:0:5827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789042809.766436:0:5827:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789042809.766438:0:5827:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789042809.766440:0:5827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789042809.766441:0:5827:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789042809.766456:0:5827:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789042809.784862:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1789042809.785117:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789042809.785300:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1789042809.785456:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789042809.785668:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789042809.785820:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1789042809.797192:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1789042809.797403:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1789042809.797693:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1789042809.798192:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1789042809.798415:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1789042809.798645:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1789042809.890044:0:5827:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1789042809.974132:0:5827:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1789042809.974509:0:5879:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789042809.977708:0:5827:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789042809.978149:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789042809.978608:0:5827:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789042809.978617:0:5827:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789042809.978782:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1789042809.978922:0:5878:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1789042809.978927:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:3.0:1789042809.981893:0:5827:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789042809.982458:0:5827:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789042809.982488:0:5827:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789042809.982801:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789042809.983044:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1789042809.984143:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1789042809.984295:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1789042809.995867:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789042809.996030:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789042809.996173:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789042809.996291:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789042809.996423:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789042809.996579:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789042809.996722:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789042809.996854:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789042809.996985:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789042809.997108:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1789042809.997241:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789042809.997382:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1789042809.997547:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1789042809.997710:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1789042809.997992:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1789042809.998128:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1789042810.018765:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1789042810.019186:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1789042810.019359:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1789042810.019546:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1789042810.019668:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1789042810.019787:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1789042810.022500:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1789042810.022709:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1789042810.027931:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1789042810.028171:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1789042810.028348:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1789042810.028496:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1789042810.028675:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1789042810.028809:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1789042810.028982:0:5827:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1789042810.056402:0:5879:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1789042810.194284:0:5827:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789042810.194349:0:5827:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffafe141cdf988 00100000:10000000:3.0:1789042810.194356:0:5827:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789042810.201130:0:5827:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789042810.201146:0:5827:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.117@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789042810.201160:0:5827:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789042810.201186:0:5827:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1789042810.228246:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789042810.301393:0:5879:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789042810.301479:0:5879:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:0.0:1789042810.301484:0:5879:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1789042811.254655:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789042812.279752:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789042813.305502:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789042814.326153:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789042814.706842:0:36:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789042814.706869:0:36:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789042814.706872:0:36:0:(import.c:65:import_set_state_nolock()) 0000000029c7f185 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789042814.706888:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000029c7f185 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:1.0:1789042814.706917:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a01b5bf2 x1875947267558656/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789042814.706969:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a01b5bf2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875947267558656:0@lo:38: 00000100:00100000:1.0:1789042814.707062:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042814.707372:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cdf9dce5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3314:1875947267558528:0@lo:400: 00000100:00100000:3.0:1789042814.707416:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042814.707625:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267558656 00000100:00100000:0.0:1789042814.707642:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267558656 00000100:00100000:1.0:1789042814.707827:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267558528 00000100:00100000:1.0:1789042814.707837:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267558528 00000100:00100000:1.0:1789042814.707894:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789042814.707904:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b5a7e99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+11:3314:x1875947267558528:12345-0@lo:400: 00000100:00100000:1.0:1789042814.707977:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b5a7e99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+11:3314:x1875947267558528:12345-0@lo:400: Request processed in 73us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042814.707985:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789042814.708081:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cdf9dce5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3314:1875947267558528:0@lo:400: 00000100:00100000:0.0:1789042814.708140:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789042814.708152:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000daeafec3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3311:x1875947267558656:12345-0@lo:38: 00010000:00080000:0.0:1789042814.708185:0:5847:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 157 last 0 00000020:00000080:0.0:1789042814.708227:0:5847:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x99260d7389c05c7d 00000004:00100000:0.0:1789042814.708273:0:5847:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789042814.708782:0:5847:0:(import.c:65:import_set_state_nolock()) 000000000421803a : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789042814.708886:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000daeafec3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875947267558656:12345-0@lo:38: Request processed in 735us (1823us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042814.708894:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789042814.709063:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a01b5bf2 x1875947267558656/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789042824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789042814.709084:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789042814.709093:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789042814.709099:0:3311:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789042814.709102:0:3311:0:(import.c:65:import_set_state_nolock()) 0000000029c7f185 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789042814.709108:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a01b5bf2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875947267558656:0@lo:38: 00000001:02000400:0.0:1789042814.868414:0:6122:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:2.0:1789042815.221552:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789042815.221563:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa06a52b8e800 from 3 10000000:01000000:2.0:1789042815.221570:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789042815.221638:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: 00000000991e013c/0x99260d7389c05c84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042815.221655:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: 00000000991e013c/0x99260d7389c05c84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042815.221671:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: 00000000991e013c/0x99260d7389c05c84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042815.221715:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000751a6054 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267558784:0@lo:101: 00000100:00100000:2.0:1789042815.221812:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042815.221904:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set 000000009abe02f9 going to sleep for 11 seconds 00000100:00100000:0.0:1789042815.222568:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267558784 00000100:00100000:0.0:1789042815.222580:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267558784 00000100:00100000:0.0:1789042815.222668:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789042815.222738:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000014584d01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+11:5844:x1875947267558784:12345-0@lo:101: 00010000:00010000:0.0:1789042815.222757:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789042815.222786:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007c359890/0x99260d7389c05c8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05c84 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042815.222819:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007c359890/0x99260d7389c05c8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05c84 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042815.222830:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007c359890/0x99260d7389c05c8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05c84 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042815.222840:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007c359890, rc 0) 00000100:00100000:0.0:1789042815.222898:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000014584d01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:5844:x1875947267558784:12345-0@lo:101: Request processed in 221us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042815.222905:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789042815.225003:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000751a6054 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267558784:0@lo:101: 00010000:00010000:2.0:1789042815.225038:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: 00000000991e013c/0x99260d7389c05c84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05c8b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042815.225051:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: 00000000991e013c/0x99260d7389c05c84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05c8b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042815.226024:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000751a6054 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267558912:0@lo:256: 00000100:00100000:2.0:1789042815.226375:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042815.226789:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set 000000009abe02f9 going to sleep for 11 seconds 00000100:00100000:2.0:1789042815.226823:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267558912 00000100:00100000:2.0:1789042815.226832:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267558912 00000100:00100000:2.0:1789042815.226901:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789042815.226915:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000305dbb3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:5844:x1875947267558912:12345-0@lo:256: 20000000:01000000:2.0:1789042815.226944:0:5839:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789042815.226980:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789042815.226986:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1789042815.228804:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000305dbb3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:5844:x1875947267558912:12345-0@lo:256: Request processed in 1885us (2422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042815.228822:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789042815.228918:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000751a6054 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267558912:0@lo:256: 10000000:01000000:2.0:1789042815.229000:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789042815.229012:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: 00000000991e013c/0x99260d7389c05c84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05c8b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042815.229025:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: 00000000991e013c/0x99260d7389c05c84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05c8b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042815.346778:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789042816.370639:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789042817.407967:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789042818.418693:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789042819.442854:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789042819.831083:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c84d9b6b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875947267559168:0@lo:400: 00000100:00100000:2.0:1789042819.831206:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042819.831289:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267559168 00000100:00100000:2.0:1789042819.831297:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267559168 00000100:00100000:2.0:1789042819.831339:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789042819.831348:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9d55259 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875947267559168:12345-0@lo:400: 00000100:00100000:2.0:1789042819.831397:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9d55259 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875947267559168:12345-0@lo:400: Request processed in 51us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042819.831405:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789042819.831446:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c84d9b6b x1875947267559168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789042835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042819.831460:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c84d9b6b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875947267559168:0@lo:400: 00000100:00100000:3.0:1789042819.831651:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000751a6054 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3315:1875947267559040:0@lo:400: 00000100:00100000:3.0:1789042819.831693:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042819.833278:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267559040 00000100:00100000:2.0:1789042819.833290:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267559040 00000100:00100000:2.0:1789042819.833335:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789042819.833343:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b323439 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:3315:x1875947267559040:12345-0@lo:400: 00000100:00100000:2.0:1789042819.833423:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b323439 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:3315:x1875947267559040:12345-0@lo:400: Request processed in 80us (1730us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042819.833430:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789042819.833544:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000751a6054 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3315:1875947267559040:0@lo:400: 00000020:00000080:3.0:1789042820.288377:0:6324:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff2bf28680 20000000:00000080:3.0:1789042820.288395:0:6324:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa06a6fc35c00 uarg=0000000000000000 20000000:01000000:3.0:1789042820.288433:0:6324:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789042820.288458:0:6324:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789042820.288463:0:6324:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789042820.288844:0:6324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1789042820.288854:0:6324:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1789042820.295312:0:6324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789042820.295605:0:6324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789042820.295670:0:6324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1789042820.295722:0:6324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1789042820.295753:0:6324:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789042820.295771:0:6324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000071b5a71c/0x99260d7389c05c92 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042820.295790:0:6324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b83454fd/0x99260d7389c05c53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05c4c expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042820.295798:0:6324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000071b5a71c/0x99260d7389c05c92 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042820.295835:0:6324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b83454fd/0x99260d7389c05c53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99260d7389c05c4c expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042820.295848:0:6324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b83454fd/0x99260d7389c05c53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99260d7389c05c4c expref: 11 pid: 5840 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042820.295861:0:6324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006de630b9 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6324:1875947267559296:0@lo:104: 00000100:00100000:3.0:1789042820.295931:0:6324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042820.295987:0:6324:0:(client.c:2716:ptlrpc_set_wait()) set 0000000045309b3e going to sleep for 11 seconds 00000100:00100000:2.0:1789042820.296018:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267559296 00000100:00100000:2.0:1789042820.296027:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267559296 00000100:00100000:2.0:1789042820.296072:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789042820.296081:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034679dae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+3:6324:x1875947267559296:12345-0@lo:104: 00010000:00010000:2.0:1789042820.296094:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: 00000000b81c6b0c/0x99260d7389c05c4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05c53 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042820.296162:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789042820.296167:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034679dae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+3:6324:x1875947267559296:12345-0@lo:104: Request processed in 89us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042820.296174:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1789042820.296782:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789042820.296788:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: 00000000b81c6b0c/0x99260d7389c05c4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05c53 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042820.296798:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b81c6b0c already unused, calling callback (00000000776f8733) 10000000:00010000:0.0:1789042820.296800:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: 00000000b81c6b0c/0x99260d7389c05c4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x99260d7389c05c53 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042820.296808:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: 00000000b81c6b0c/0x99260d7389c05c4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x99260d7389c05c53 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789042820.296815:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: 00000000b81c6b0c/0x99260d7389c05c4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x99260d7389c05c53 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789042820.296821:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789042820.296856:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: 00000000b81c6b0c/0x99260d7389c05c4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05c53 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042820.297776:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789042820.297801:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: 00000000b81c6b0c/0x99260d7389c05c4c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05c53 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042820.297810:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: 00000000b81c6b0c/0x99260d7389c05c4c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05c53 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042820.297828:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789042820.297830:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789042820.297831:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789042820.297850:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789042820.297865:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006ed94709 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267559424:0@lo:103: 00000100:00100000:0.0:1789042820.298121:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042820.298217:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267559424 00000100:00100000:2.0:1789042820.298225:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267559424 00010000:00010000:2.0:1789042820.298247:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b83454fd/0x99260d7389c05c53 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05c4c expref: 12 pid: 5840 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042820.298286:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789042820.298295:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084dcff49 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:3312:x1875947267559424:12345-0@lo:103: 00010000:00010000:2.0:1789042820.298305:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789042820.298309:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b83454fd/0x99260d7389c05c53 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05c4c expref: 12 pid: 5840 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042820.298320:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b83454fd/0x99260d7389c05c53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99260d7389c05c4c expref: 12 pid: 5840 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042820.298337:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000071b5a71c/0x99260d7389c05c92 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042820.298345:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000071b5a71c/0x99260d7389c05c92 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042820.298359:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000071b5a71c/0x99260d7389c05c92 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042820.298365:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000071b5a71c/0x99260d7389c05c92 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042820.298380:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000071b5a71c/0x99260d7389c05c92 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042820.298386:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000071b5a71c/0x99260d7389c05c92 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042820.298391:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000071b5a71c already unused, calling callback (00000000a8e9cfc1) 00010000:00010000:2.0:1789042820.298395:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000071b5a71c/0x99260d7389c05c92 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042820.298402:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000071b5a71c/0x99260d7389c05c92 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042820.298409:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000071b5a71c/0x99260d7389c05c92 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042820.298418:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789042820.298449:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084dcff49 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:3312:x1875947267559424:12345-0@lo:103: Request processed in 156us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042820.298456:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789042820.298553:0:6324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b83454fd/0x99260d7389c05c53 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99260d7389c05c4c expref: 11 pid: 5840 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042820.298565:0:6324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006de630b9 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6324:1875947267559296:0@lo:104: 00010000:00010000:3.0:1789042820.298583:0:6324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000071b5a71c/0x99260d7389c05c92 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042820.298591:0:6324:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000071b5a71c/0x99260d7389c05c92 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042820.298596:0:6324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000071b5a71c/0x99260d7389c05c92 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042820.298601:0:6324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000071b5a71c/0x99260d7389c05c92 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042820.317372:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006ed94709 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267559424:0@lo:103: 00010000:00010000:0.0:1789042820.475004:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789042820.918285:0:5844:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789042820.918293:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa06a52b8e800 from 1 10000000:01000000:0.0:1789042820.918299:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789042820.918341:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: 00000000a24a1ae0/0x99260d7389c05c99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042820.918354:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: 00000000a24a1ae0/0x99260d7389c05c99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042820.918364:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: 00000000a24a1ae0/0x99260d7389c05c99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042820.918385:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006ed94709 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267559552:0@lo:101: 00000100:00100000:0.0:1789042820.918451:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042820.918537:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aa7b2106 going to sleep for 11 seconds 00000100:00100000:3.0:1789042820.918566:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267559552 00000100:00100000:3.0:1789042820.918575:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267559552 00000100:00100000:3.0:1789042820.918628:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789042820.918650:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0d2218d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+11:5844:x1875947267559552:12345-0@lo:101: 00010000:00010000:3.0:1789042820.918665:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789042820.918678:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000071b5a71c/0x99260d7389c05ca0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05c99 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042820.918701:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000071b5a71c/0x99260d7389c05ca0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05c99 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042820.918711:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000071b5a71c/0x99260d7389c05ca0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05c99 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042820.918746:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000071b5a71c, rc 0) 00000100:00100000:3.0:1789042820.918795:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0d2218d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:5844:x1875947267559552:12345-0@lo:101: Request processed in 145us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042820.918801:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789042820.918846:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006ed94709 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267559552:0@lo:101: 00010000:00010000:3.0:1789042820.918858:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: 00000000a24a1ae0/0x99260d7389c05c99 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05ca0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042820.918867:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: 00000000a24a1ae0/0x99260d7389c05c99 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05ca0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042820.919190:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006de630b9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267559680:0@lo:501: 00000100:00100000:3.0:1789042820.919219:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042820.919312:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bb5f50e2 going to sleep for 11 seconds 00000100:00100000:1.0:1789042820.922587:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267559680 00000100:00100000:1.0:1789042820.922603:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267559680 00000100:00100000:1.0:1789042820.922663:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789042820.922673:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d45610a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:5844:x1875947267559680:12345-0@lo:501: 00000100:00100000:1.0:1789042820.922990:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d45610a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:5844:x1875947267559680:12345-0@lo:501: Request processed in 318us (3769us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042820.922998:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789042820.923052:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006de630b9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267559680:0@lo:501: 00000100:00100000:1.0:1789042820.923099:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a01b5bf2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267559808:0@lo:503: 00000100:00100000:1.0:1789042820.923146:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042820.923178:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set 0000000099a3c9bb going to sleep for 11 seconds 00000100:00100000:1.0:1789042820.923193:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267559808 00000100:00100000:1.0:1789042820.923197:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267559808 00000100:00100000:1.0:1789042820.923228:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789042820.923235:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c3b774d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:5844:x1875947267559808:12345-0@lo:503: 00000100:00100000:1.0:1789042820.923394:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c3b774d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:5844:x1875947267559808:12345-0@lo:503: Request processed in 147us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042820.923401:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789042820.923435:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a01b5bf2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267559808:0@lo:503: 00000100:00100000:1.0:1789042820.924232:0:6344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a01b5bf2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6344:1875947267559936:0@lo:502: 00000100:00100000:1.0:1789042820.924290:0:6344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042820.924317:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267559936 00000100:00100000:1.0:1789042820.924322:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267559936 00000100:00100000:1.0:1789042820.924347:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789042820.924353:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e380d9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:6344:x1875947267559936:12345-0@lo:502: 00000100:00100000:1.0:1789042820.924500:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e380d9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:6344:x1875947267559936:12345-0@lo:502: Request processed in 145us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042820.924506:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789042820.924564:0:6344:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c2a782a0 going to sleep for 11 seconds 00000100:00100000:1.0:1789042820.924586:0:6344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a01b5bf2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6344:1875947267559936:0@lo:502: 00000020:01000000:1.0:1789042820.924609:0:6344:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789042820.924618:0:6344:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789042820.924620:0:6344:0:(obd_config.c:1661:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789042820.924628:0:6344:0:(obd_config.c:2102:class_config_llog_handler()) cmd ce032, instance name: general-ffffa06a52b8e800 00000020:00000080:1.0:1789042820.924644:0:6344:0:(obd_config.c:1570:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789042820.924683:0:6344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6344:1875947267560064:0@lo:502: 00000100:00100000:1.0:1789042820.924715:0:6344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042820.925078:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267560064 00000100:00100000:1.0:1789042820.925084:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267560064 00000100:00100000:1.0:1789042820.925108:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789042820.925115:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:6344:x1875947267560064:12345-0@lo:502: 00000100:00100000:1.0:1789042820.925229:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:6344:x1875947267560064:12345-0@lo:502: Request processed in 114us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042820.925236:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789042820.925277:0:6344:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a467dccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789042820.925290:0:6344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6344:1875947267560064:0@lo:502: 00000020:01000000:1.0:1789042820.925306:0:6344:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789042820.925310:0:6344:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789042820.925312:0:6344:0:(obd_config.c:1661:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789042820.925315:0:6344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1789042820.925358:0:5844:0:(obd_config.c:2243:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789042820.925373:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789042820.925395:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a40031000/0x99260d7389c05c99 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05ca0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042820.925406:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a40031000/0x99260d7389c05c99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05ca0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042821.491039:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789042822.516173:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789042823.543808:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789042824.562653:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789042824.949277:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a520c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3314:1875947267560192:0@lo:400: 00000100:00100000:2.0:1789042824.949346:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042824.949397:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789042824.949403:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a520c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267560320:0@lo:400: 00000100:00100000:2.0:1789042824.949495:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042824.949565:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267560192 00000100:00100000:2.0:1789042824.949574:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267560192 00000100:00100000:2.0:1789042824.949616:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789042824.949624:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:3314:x1875947267560192:12345-0@lo:400: 00000100:00100000:2.0:1789042824.949681:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:3314:x1875947267560192:12345-0@lo:400: Request processed in 57us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042824.949688:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789042824.949720:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267560320 00000100:00100000:2.0:1789042824.949723:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267560320 00000100:00100000:2.0:1789042824.949749:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789042824.949755:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75eddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267560320:12345-0@lo:400: 00000100:00100000:2.0:1789042824.949785:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75eddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267560320:12345-0@lo:400: Request processed in 31us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042824.949791:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789042824.949827:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa06a520c1c00 x1875947267560320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789042840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042824.949841:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a520c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267560320:0@lo:400: 00000100:00100000:2.0:1789042824.949851:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a520c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3314:1875947267560192:0@lo:400: 00010000:00010000:1.0:1789042825.588554:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789042826.611217:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789042827.464087:0:6687:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789042827.464091:0:6687:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1789042827.464231:0:6687:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa06a7924c000 00000020:01000004:0.0:1789042827.464247:0:6687:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1789042827.464259:0:6687:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789042827.464274:0:6687:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0000-osd (ffffa06a47344d88) 00000020:00000080:0.0:1789042827.464289:0:6687:0:(obd_config.c:786:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789042827.491480:0:6687:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1789042827.491997:0:6687:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789042827.564417:0:6687:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789042827.602009:0:6687:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789042827.602049:0:6687:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789042827.602106:0:6687:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789042827.602132:0:6687:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789042827.602548:0:6687:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789042827.602559:0:6687:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789042827.602568:0:6687:0:(genops.c:1393:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x99260d7389c05cae 00000020:01000004:3.0:1789042827.602576:0:6687:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789042827.603779:0:6687:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.117@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789042827.603785:0:6687:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.117@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789042827.603793:0:6687:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789042827.603799:0:6687:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789042827.603813:0:6687:0:(genops.c:415:class_newdev()) Allocate new device OSS (ffffa06a52ca33b0) 00000020:00000080:3.0:1789042827.603827:0:6687:0:(obd_config.c:786:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1789042827.608649:0:6687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789042827.615898:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789042827.615907:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789042827.623934:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789042827.623947:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00010000:00010000:1.0:1789042827.636115:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789042827.637981:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1789042827.641324:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789042827.643429:0:6687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789042827.643659:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789042827.643665:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789042827.647397:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789042827.647411:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789042827.709543:0:6687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789042827.710190:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789042827.710198:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789042827.713815:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789042827.713829:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789042827.718898:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789042827.718914:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789042827.724234:0:6687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789042827.724439:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789042827.724446:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789042827.732451:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789042827.732466:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789042827.869075:0:6687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789042827.874233:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789042827.874245:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789042827.885114:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789042827.885129:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789042827.886157:0:6687:0:(obd_config.c:900:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789042827.886182:0:6687:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1789042827.886189:0:6687:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.117@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789042827.940882:0:6687:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.117@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789042827.940918:0:6687:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.117@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1789042827.940922:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789042827.940924:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789042827.940925:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789042827.940926:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789042827.940927:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789042827.940929:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789042827.940931:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789042827.940932:0:6687:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789042827.940933:0:6687:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789042827.940935:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789042827.940936:0:6687:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789042827.940939:0:6687:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1789042827.940941:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789042827.940943:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789042827.940944:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789042827.940945:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789042827.940946:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789042827.940947:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789042827.940948:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789042827.940949:0:6687:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789042827.940950:0:6687:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789042827.940951:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789042827.940952:0:6687:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789042827.940988:0:6687:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789042827.941008:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75eded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267560448:0@lo:253: 00000100:00100000:2.0:1789042827.941076:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042827.947222:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7608a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789042827.948119:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267560448 00000100:00100000:1.0:1789042827.948130:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267560448 00000100:00100000:1.0:1789042827.948230:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789042827.948241:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:6687:x1875947267560448:12345-0@lo:253: 20000000:01000000:1.0:1789042827.948275:0:5840:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789042827.948279:0:5840:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1789042827.948285:0:5840:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1789042827.948288:0:5840:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1789042827.956152:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789042827.956393:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1789042827.956409:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1789042827.956447:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1789042827.956454:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1789042827.956483:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1789042827.956555:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1789042827.958260:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1789042827.958287:0:5840:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.117@tcp 20000000:01000000:1.0:1789042827.958289:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.117@tcp (null) (null) (null) 00000040:00080000:1.0:1789042827.958448:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1789042827.958459:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789042827.958645:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1789042827.958656:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.117@tcp (null) (null) 00000040:00080000:1.0:1789042827.958757:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1789042827.958768:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789042827.958800:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1789042827.958878:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1789042827.961275:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1789042827.961303:0:5840:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.117@tcp 20000000:01000000:1.0:1789042827.961305:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.117@tcp (null) (null) (null) 00000040:00080000:1.0:1789042827.962319:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1789042827.962333:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789042827.962439:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1789042827.962447:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.117@tcp (null) (null) 00000040:00080000:1.0:1789042827.962503:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1789042827.963407:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789042827.966465:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1789042827.966543:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1789042827.966567:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789042827.966571:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789042827.966574:0:5840:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789042827.966586:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789042827.966771:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789042827.966822:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789042827.966825:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789042827.969640:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1789042827.970048:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1789042827.970097:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1789042827.970168:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1789042827.970182:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789042827.970185:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789042827.974864:0:6703:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1789042827.974954:0:6703:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1789042827.975003:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1789042827.975481:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1789042827.975567:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1789042827.975904:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1789042827.975926:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789042827.975928:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789042827.976775:0:6704:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1789042827.976833:0:6704:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1789042827.976898:0:6704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1789042827.981825:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1789042827.981884:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1789042827.981960:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1789042827.981980:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1789042827.981982:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1789042827.981992:0:5840:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789042827.982011:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa06a429f4a00/0x99260d7389c05cbc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042827.982029:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a429f4c00/0x99260d7389c05bd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05bce expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042827.982036:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a41687200/0x99260d7389c05bf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05bea expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042827.982042:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a429f5000/0x99260d7389c05c61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05c5a expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042827.982065:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa06a429f4a00/0x99260d7389c05cbc lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042827.982105:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a429f5000/0x99260d7389c05c61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99260d7389c05c5a expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042827.982120:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa06a429f5000/0x99260d7389c05c61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99260d7389c05c5a expref: 12 pid: 5839 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042827.982134:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a027b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1875947267560576:0@lo:104: 00000100:00100000:3.0:1789042827.982198:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789042827.982272:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a41687200/0x99260d7389c05bf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99260d7389c05bea expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042827.982281:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa06a41687200/0x99260d7389c05bf1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99260d7389c05bea expref: 12 pid: 5839 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042827.982290:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a026a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1875947267560704:0@lo:104: 00000100:00100000:3.0:1789042827.982312:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789042827.982746:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a429f4c00/0x99260d7389c05bd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99260d7389c05bce expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042827.982757:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa06a429f4c00/0x99260d7389c05bd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99260d7389c05bce expref: 12 pid: 5839 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042827.982767:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a026680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1875947267560832:0@lo:104: 00000100:00100000:3.0:1789042827.982794:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042827.982806:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a6ee9dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789042827.982881:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267560576 00000100:00100000:1.0:1789042827.982889:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267560576 00000100:00100000:1.0:1789042827.982928:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267560704 00000100:00100000:1.0:1789042827.982931:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267560704 00000100:00100000:1.0:1789042827.982940:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267560832 00000100:00100000:1.0:1789042827.982942:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267560832 00000100:00100000:1.0:1789042827.982954:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789042827.982961:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a025500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+5:5840:x1875947267560576:12345-0@lo:104: 00010000:00010000:1.0:1789042827.982986:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c05c5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05c61 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042827.983048:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789042827.983054:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a025500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+5:5840:x1875947267560576:12345-0@lo:104: Request processed in 93us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042827.983071:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789042827.983089:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789042827.983095:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a024000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+4:5840:x1875947267560704:12345-0@lo:104: 00010000:00010000:1.0:1789042827.983102:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05bea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05bf1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042827.983150:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789042827.983156:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a024000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+4:5840:x1875947267560704:12345-0@lo:104: Request processed in 61us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042827.983161:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789042827.983174:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789042827.983179:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a025c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+3:5840:x1875947267560832:12345-0@lo:104: 00010000:00010000:1.0:1789042827.983186:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffffa06a58604600/0x99260d7389c05bce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05bd5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042827.983221:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789042827.983226:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a025c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+3:5840:x1875947267560832:12345-0@lo:104: Request processed in 48us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042827.983232:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1789042827.983248:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789042827.983253:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c05c5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05c61 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042827.983260:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a58604400 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:1.0:1789042827.983263:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c05c5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x99260d7389c05c61 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042827.983282:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c05c5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x99260d7389c05c61 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789042827.983289:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c05c5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x99260d7389c05c61 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789042827.983294:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789042827.983323:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c05c5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05c61 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042827.983329:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789042827.983355:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c05c5a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05c61 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042827.983363:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c05c5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05c61 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042827.983376:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789042827.983379:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05bea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05bf1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042827.983384:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a40030400 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:1.0:1789042827.983387:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05bea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x99260d7389c05bf1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042827.983392:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05bea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x99260d7389c05bf1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789042827.983398:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05bea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x99260d7389c05bf1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789042827.983408:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789042827.983422:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05bea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05bf1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042827.983427:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789042827.983433:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05bea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05bf1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042827.983439:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05bea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05bf1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042827.983448:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789042827.983451:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a58604600/0x99260d7389c05bce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05bd5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042827.983456:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a58604600 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:1.0:1789042827.983459:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a58604600/0x99260d7389c05bce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x99260d7389c05bd5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042827.983466:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a58604600/0x99260d7389c05bce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x99260d7389c05bd5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789042827.983472:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a58604600/0x99260d7389c05bce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x99260d7389c05bd5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789042827.983478:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789042827.983489:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a58604600/0x99260d7389c05bce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05bd5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042827.983495:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789042827.983547:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a58604600/0x99260d7389c05bce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05bd5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042827.983555:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a58604600/0x99260d7389c05bce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05bd5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042827.983569:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789042827.983571:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789042827.983573:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789042827.983697:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789042827.983989:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a027b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1875947267560576:0@lo:104: 00000100:00100000:3.0:1789042827.984007:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a026a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1875947267560704:0@lo:104: 00000100:00100000:3.0:1789042827.984014:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a026680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1875947267560832:0@lo:104: 00010000:00010000:3.0:1789042827.984033:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa06a429f4a00/0x99260d7389c05cbc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042827.984073:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267560960:0@lo:103: 00000100:00100000:1.0:1789042827.984107:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042827.984148:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789042827.984153:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267561088:0@lo:103: 00000100:00100000:1.0:1789042827.984173:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042827.984217:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3314:1875947267561216:0@lo:103: 00000100:00100000:1.0:1789042827.984239:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042827.984272:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267560960 00000100:00100000:1.0:1789042827.984277:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267560960 00010000:00010000:1.0:1789042827.984294:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a429f5000/0x99260d7389c05c61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05c5a expref: 13 pid: 5839 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042827.984309:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267561088 00000100:00100000:1.0:1789042827.984312:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267561088 00010000:00010000:1.0:1789042827.984322:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a41687200/0x99260d7389c05bf1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05bea expref: 14 pid: 5839 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042827.984332:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267561216 00000100:00100000:1.0:1789042827.984394:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267561216 00010000:00010000:1.0:1789042827.984407:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a429f4c00/0x99260d7389c05bd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05bce expref: 15 pid: 5839 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042827.984434:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789042827.984441:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:3312:x1875947267560960:12345-0@lo:103: 00010000:00010000:1.0:1789042827.984451:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789042827.984455:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a429f5000/0x99260d7389c05c61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05c5a expref: 15 pid: 5839 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042827.984466:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a429f5000/0x99260d7389c05c61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99260d7389c05c5a expref: 15 pid: 5839 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042827.984480:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a429f5000/0x99260d7389c05c61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99260d7389c05c5a expref: 15 pid: 5839 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042827.984494:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789042827.984550:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+14:3312:x1875947267560960:12345-0@lo:103: Request processed in 110us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042827.984557:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789042827.984571:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789042827.984577:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:3312:x1875947267561088:12345-0@lo:103: 00010000:00010000:1.0:1789042827.984584:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789042827.984588:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a41687200/0x99260d7389c05bf1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05bea expref: 13 pid: 5839 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042827.984672:0:5831:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789042827.984681:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1789042827.984791:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789042827.984798:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:3314:x1875947267561216:12345-0@lo:103: 00010000:00010000:0.0:1789042827.984806:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789042827.984811:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a429f4c00/0x99260d7389c05bd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05bce expref: 13 pid: 5839 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042827.984819:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a429f4c00/0x99260d7389c05bd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99260d7389c05bce expref: 13 pid: 5839 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042827.984828:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a429f4c00/0x99260d7389c05bd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99260d7389c05bce expref: 13 pid: 5839 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042827.984838:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789042827.984868:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:3314:x1875947267561216:12345-0@lo:103: Request processed in 71us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042827.984874:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1789042827.985079:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a41687200/0x99260d7389c05bf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99260d7389c05bea expref: 11 pid: 5839 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042827.985089:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a41687200/0x99260d7389c05bf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99260d7389c05bea expref: 11 pid: 5839 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042827.985131:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa06a429f4a00/0x99260d7389c05cbc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042827.985140:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a429f4a00/0x99260d7389c05cbc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042827.985154:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa06a429f4a00/0x99260d7389c05cbc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042827.985160:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa06a429f4a00/0x99260d7389c05cbc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042827.985167:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa06a429f4a00/0x99260d7389c05cbc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042827.985173:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa06a429f4a00/0x99260d7389c05cbc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042827.985178:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a429f4a00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:1.0:1789042827.985181:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa06a429f4a00/0x99260d7389c05cbc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042827.985188:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa06a429f4a00/0x99260d7389c05cbc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042827.986575:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267560960:0@lo:103: 00010000:00010000:2.0:1789042827.986918:0:5840:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa06a429f4a00/0x99260d7389c05cbc lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042827.986928:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa06a429f4a00/0x99260d7389c05cbc lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789042827.986937:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:1.0:1789042827.988536:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa06a429f4a00/0x99260d7389c05cbc lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042827.988560:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a429f4a00/0x99260d7389c05cbc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042827.988606:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789042827.988676:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+10:3312:x1875947267561088:12345-0@lo:103: Request processed in 4098us (4500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042827.988848:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267561088:0@lo:103: 00000100:00100000:1.0:1789042827.988968:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789042827.991835:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3314:1875947267561216:0@lo:103: 00000100:00100000:0.0:1789042828.056553:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+9:6687:x1875947267560448:12345-0@lo:253: Request processed in 108274us (115437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042828.056583:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789042828.056965:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75eded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267560448:0@lo:253: 10000000:01000000:1.0:1789042828.056980:0:6687:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789042828.056983:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789042828.056984:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789042828.056986:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789042828.056987:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1789042828.056988:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789042828.056989:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789042828.056990:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789042828.056991:0:6687:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789042828.056993:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789042828.056995:0:6687:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789042828.057012:0:6687:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa06a7924c000 from lustre-OST0000 10000000:01000000:1.0:1789042828.057046:0:6687:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789042828.057050:0:6687:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789042828.057056:0:6687:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa06a5209cd88 local copy 10000000:01000000:1.0:1789042828.057060:0:6687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789042828.057095:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41687200/0x99260d7389c05cc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042828.057106:0:6687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.117@tcp lock: ffffa06a41687200/0x99260d7389c05cc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042828.057115:0:6687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a41687200/0x99260d7389c05cc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042828.057134:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267561344:0@lo:101: 00000100:00100000:1.0:1789042828.057179:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042828.057248:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a482526c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789042828.057309:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267561344 00000100:00100000:2.0:1789042828.057317:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267561344 00000100:00100000:2.0:1789042828.057356:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789042828.057364:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+9:6687:x1875947267561344:12345-0@lo:101: 00010000:00010000:2.0:1789042828.057376:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789042828.057388:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a58604800/0x99260d7389c05cca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05cc3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042828.057413:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a58604800/0x99260d7389c05cca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05cc3 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042828.057424:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a58604800/0x99260d7389c05cca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05cc3 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042828.057433:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a58604800, rc 0) 00000100:00100000:2.0:1789042828.057467:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+10:6687:x1875947267561344:12345-0@lo:101: Request processed in 103us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042828.057473:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789042828.057552:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267561344:0@lo:101: 00010000:00010000:3.0:1789042828.057565:0:6687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a41687200/0x99260d7389c05cc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x99260d7389c05cca expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042828.057574:0:6687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a41687200/0x99260d7389c05cc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x99260d7389c05cca expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042828.057672:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a026680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267561472:0@lo:501: 00000100:00100000:3.0:1789042828.057710:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042828.057731:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a51814300 going to sleep for 11 seconds 00000100:00100000:1.0:1789042828.057881:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267561472 00000100:00100000:1.0:1789042828.057885:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267561472 00000100:00100000:1.0:1789042828.057983:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789042828.057991:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+10:6687:x1875947267561472:12345-0@lo:501: 00000100:00100000:1.0:1789042828.058191:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+10:6687:x1875947267561472:12345-0@lo:501: Request processed in 200us (479us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789042828.058198:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789042828.058270:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a026680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267561472:0@lo:501: 10000000:01000000:3.0:1789042828.058283:0:6687:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.117@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789042828.058308:0:6687:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.117@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789042828.058314:0:6687:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41687200/0x99260d7389c05cc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x99260d7389c05cca expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042828.058323:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41687200/0x99260d7389c05cc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x99260d7389c05cca expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042828.058331:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffffa06a41687200/0x99260d7389c05cc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x99260d7389c05cca expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042828.058366:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789042828.058382:0:6687:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa06a7924c000 10000000:01000000:3.0:1789042828.058387:0:6687:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789042828.058392:0:6687:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffffa06a5209cd88 10000000:01000000:3.0:1789042828.058394:0:6687:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789042828.058397:0:6687:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffffa06a5209cd88 from 1 10000000:01000000:3.0:1789042828.058400:0:6687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789042828.058420:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a429f5c00/0x99260d7389c05cd1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042828.058428:0:6687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a429f5c00/0x99260d7389c05cd1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042828.058435:0:6687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a429f5c00/0x99260d7389c05cd1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042828.058447:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a026680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267561600:0@lo:101: 00000100:00100000:3.0:1789042828.058473:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042828.064549:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a51814480 going to sleep for 11 seconds 00000100:00100000:2.0:1789042828.064714:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267561600 00000100:00100000:2.0:1789042828.064724:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267561600 00000100:00100000:2.0:1789042828.064771:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789042828.064781:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+10:6687:x1875947267561600:12345-0@lo:101: 00010000:00010000:2.0:1789042828.064798:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789042828.064818:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a58605800/0x99260d7389c05cd8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05cd1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042828.064845:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a58605800/0x99260d7389c05cd8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05cd1 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042828.064856:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a58605800/0x99260d7389c05cd8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05cd1 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042828.064879:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a58605800, rc 0) 00000100:00100000:2.0:1789042828.064936:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+11:6687:x1875947267561600:12345-0@lo:101: Request processed in 158us (6463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042828.064942:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789042828.065101:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a026680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267561600:0@lo:101: 00010000:00010000:3.0:1789042828.065117:0:6687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a429f5c00/0x99260d7389c05cd1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05cd8 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042828.065127:0:6687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a429f5c00/0x99260d7389c05cd1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05cd8 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789042828.065146:0:6687:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789042828.065167:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a429f5c00/0x99260d7389c05cd1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05cd8 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042828.065182:0:6687:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a429f5c00/0x99260d7389c05cd1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05cd8 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789042828.065191:0:6687:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789042828.065196:0:6687:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789042828.065203:0:6687:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789042828.065205:0:6687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789042828.065239:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a429f4200/0x99260d7389c05cdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042828.065246:0:6687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a429f4200/0x99260d7389c05cdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042828.065255:0:6687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a429f4200/0x99260d7389c05cdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042828.065272:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a026680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267561728:0@lo:101: 00000100:00100000:3.0:1789042828.065303:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042828.065320:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a51814480 going to sleep for 11 seconds 00000100:00100000:2.0:1789042828.065446:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267561728 00000100:00100000:2.0:1789042828.065451:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267561728 00000100:00100000:2.0:1789042828.065469:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789042828.065476:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+11:6687:x1875947267561728:12345-0@lo:101: 00010000:00010000:2.0:1789042828.065483:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789042828.065491:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a58605400/0x99260d7389c05ce6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05cdf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042828.065504:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a58605400/0x99260d7389c05ce6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05cdf expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042828.065529:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a58605400/0x99260d7389c05ce6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05cdf expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042828.065537:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a58605400, rc 0) 00000100:00100000:2.0:1789042828.065573:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:6687:x1875947267561728:12345-0@lo:101: Request processed in 97us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042828.065579:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789042828.065784:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a026680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267561728:0@lo:101: 00010000:00010000:3.0:1789042828.065795:0:6687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a429f4200/0x99260d7389c05cdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05ce6 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042828.065803:0:6687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a429f4200/0x99260d7389c05cdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05ce6 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042828.065891:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a026680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267561856:0@lo:501: 00000100:00100000:3.0:1789042828.065925:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042828.065951:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a51814480 going to sleep for 11 seconds 00000100:00100000:0.0:1789042828.066071:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267561856 00000100:00100000:0.0:1789042828.066076:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267561856 00000100:00100000:0.0:1789042828.066099:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789042828.066106:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:6687:x1875947267561856:12345-0@lo:501: 00000100:00100000:0.0:1789042828.066333:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:6687:x1875947267561856:12345-0@lo:501: Request processed in 226us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042828.066340:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789042828.066418:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a026680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267561856:0@lo:501: 00000100:00100000:3.0:1789042828.066446:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a026680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267561984:0@lo:503: 00000100:00100000:3.0:1789042828.066483:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042828.066504:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a51814480 going to sleep for 11 seconds 00010000:00010000:3.0:1789042828.066553:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789042828.066560:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a41687200/0x99260d7389c05cc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x99260d7389c05cca expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042828.066568:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687200 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:3.0:1789042828.066571:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a41687200/0x99260d7389c05cc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x99260d7389c05cca expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042828.066580:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a41687200/0x99260d7389c05cc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x99260d7389c05cca expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789042828.066586:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a41687200/0x99260d7389c05cc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x99260d7389c05cca expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789042828.066601:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789042828.066619:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a41687200/0x99260d7389c05cc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x99260d7389c05cca expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042828.066625:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789042828.066642:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a41687200/0x99260d7389c05cc3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x99260d7389c05cca expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042828.066648:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a41687200/0x99260d7389c05cc3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x99260d7389c05cca expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042828.066666:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789042828.066668:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789042828.066669:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789042828.066814:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789042828.066826:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3314:1875947267562112:0@lo:103: 00000100:00100000:0.0:1789042828.066854:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042828.066897:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267561984 00000100:00100000:0.0:1789042828.066902:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267561984 00000100:00100000:0.0:1789042828.066919:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789042828.066924:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:6687:x1875947267561984:12345-0@lo:503: 00000100:00100000:0.0:1789042828.067065:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:6687:x1875947267561984:12345-0@lo:503: Request processed in 139us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042828.067072:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789042828.067105:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a026680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267561984:0@lo:503: 00000040:00080000:0.0:1789042828.067395:0:6687:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789042828.067459:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a520c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267562240:0@lo:502: 00000100:00100000:0.0:1789042828.067492:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042828.067503:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a45384300 going to sleep for 11 seconds 00000100:00100000:0.0:1789042828.067547:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267562240 00000100:00100000:0.0:1789042828.067552:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267562240 00000100:00100000:0.0:1789042828.067569:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789042828.067581:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:6687:x1875947267562240:12345-0@lo:502: 00000100:00100000:0.0:1789042828.067833:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:6687:x1875947267562240:12345-0@lo:502: Request processed in 252us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042828.067840:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789042828.067871:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a520c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267562240:0@lo:502: 00000040:00080000:0.0:1789042828.068066:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789042828.068111:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789042828.068145:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789042828.068192:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789042828.068243:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789042828.068278:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789042828.068298:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a520c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267562368:0@lo:502: 00000100:00100000:0.0:1789042828.068332:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042828.068342:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a45384300 going to sleep for 11 seconds 00000100:00100000:0.0:1789042828.068363:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267562368 00000100:00100000:0.0:1789042828.068366:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267562368 00000100:00100000:0.0:1789042828.068381:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789042828.068386:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:6687:x1875947267562368:12345-0@lo:502: 00000100:00100000:0.0:1789042828.068494:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:6687:x1875947267562368:12345-0@lo:502: Request processed in 107us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042828.068501:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789042828.068551:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a520c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267562368:0@lo:502: 00000040:00080000:0.0:1789042828.068933:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789042828.068943:0:6687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000100:00100000:3.0:1789042828.069254:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267562112 00000100:00100000:3.0:1789042828.069260:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267562112 00000100:00100000:3.0:1789042828.069292:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789042828.069299:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a520c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:3314:x1875947267562112:12345-0@lo:103: 00010000:00010000:3.0:1789042828.069311:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789042828.069328:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a58604800/0x99260d7389c05cca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x99260d7389c05cc3 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042828.069341:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789042828.069374:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a520c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+11:3314:x1875947267562112:12345-0@lo:103: Request processed in 75us (2519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042828.069381:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789042828.069586:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3314:1875947267562112:0@lo:103: 00000020:01000000:2.0:1789042828.071943:0:6706:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789042828.071955:0:6706:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1789042828.071962:0:6706:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789042828.071965:0:6706:0:(obd_config.c:1661:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789042828.071985:0:6706:0:(obd_config.c:1570:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789042828.072012:0:6706:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0000 (ffffa06a7fae19d8) 00000020:00000080:2.0:1789042828.072035:0:6706:0:(obd_config.c:786:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789042828.072042:0:6706:0:(obd_config.c:1570:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789042828.072102:0:6706:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa06a7924c000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789042828.072110:0:6706:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789042828.072117:0:6706:0:(genops.c:1393:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x99260d7389c05cf4 00010000:00010000:2.0:1789042828.089288:0:6706:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1789042828.089617:0:6706:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1789042828.095563:0:6706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789042828.095852:0:6706:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1789042828.118060:0:6706:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1789042828.121905:0:6706:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1789042828.123450:0:6706:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789042828.123462:0:6706:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789042828.123468:0:6706:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789042828.123470:0:6706:0:(obd_config.c:1661:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789042828.123474:0:6706:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789042828.123478:0:6706:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789042828.123479:0:6706:0:(obd_config.c:1661:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789042828.123482:0:6706:0:(obd_config.c:1570:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789042828.123484:0:6706:0:(obd_config.c:1635:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789042828.123564:0:6706:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789042828.123568:0:6706:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789042828.123570:0:6706:0:(obd_config.c:1661:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789042828.123573:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1789042828.125614:0:6687:0:(obd_config.c:2243:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1789042828.125648:0:6687:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789042828.125669:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a429f4200/0x99260d7389c05cdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05ce6 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042828.125802:0:6687:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a429f4200/0x99260d7389c05cdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05ce6 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789042828.125813:0:6687:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa06a7924c000 from 1 10000000:01000000:0.0:1789042828.125816:0:6687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789042828.125851:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05cfb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042828.125859:0:6687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05cfb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042828.125869:0:6687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05cfb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042828.125892:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a520c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267562496:0@lo:101: 00000100:00100000:0.0:1789042828.125957:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042828.126011:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a45384780 going to sleep for 11 seconds 00000100:00100000:1.0:1789042828.126094:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267562496 00000100:00100000:1.0:1789042828.126102:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267562496 00000100:00100000:1.0:1789042828.126152:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789042828.126162:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+11:6687:x1875947267562496:12345-0@lo:101: 00010000:00010000:1.0:1789042828.126176:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789042828.126189:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a41687000/0x99260d7389c05d02 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05cfb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042828.126222:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a41687000/0x99260d7389c05d02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05cfb expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042828.126232:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a41687000/0x99260d7389c05d02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05cfb expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042828.126240:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41687000, rc 0) 00000100:00100000:1.0:1789042828.126283:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:6687:x1875947267562496:12345-0@lo:101: Request processed in 123us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042828.126289:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789042828.126345:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a520c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267562496:0@lo:101: 00010000:00010000:1.0:1789042828.126378:0:6687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05cfb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05d02 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042828.126387:0:6687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05cfb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05d02 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042828.126476:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267562624:0@lo:501: 00000100:00100000:1.0:1789042828.126501:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042828.126546:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a48252f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789042828.126562:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267562624 00000100:00100000:1.0:1789042828.126566:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267562624 00000100:00100000:1.0:1789042828.126602:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789042828.126608:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46e78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:6687:x1875947267562624:12345-0@lo:501: 00000100:00100000:1.0:1789042828.126989:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46e78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:6687:x1875947267562624:12345-0@lo:501: Request processed in 380us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042828.126996:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789042828.127028:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267562624:0@lo:501: 00000100:00100000:1.0:1789042828.127056:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267562752:0@lo:503: 00000100:00100000:1.0:1789042828.127091:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042828.127104:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a48252f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789042828.127117:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267562752 00000100:00100000:1.0:1789042828.127120:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267562752 00000100:00100000:1.0:1789042828.127137:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789042828.127142:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:6687:x1875947267562752:12345-0@lo:503: 00000100:00100000:1.0:1789042828.129545:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:6687:x1875947267562752:12345-0@lo:503: Request processed in 2394us (2445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042828.129558:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789042828.129779:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267562752:0@lo:503: 00000040:00080000:1.0:1789042828.130095:0:6687:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789042828.130166:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267562880:0@lo:502: 00000100:00100000:1.0:1789042828.130230:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042828.130264:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a48252f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789042828.130368:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267562880 00000100:00100000:0.0:1789042828.130374:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267562880 00000100:00100000:0.0:1789042828.130413:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789042828.130422:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:6687:x1875947267562880:12345-0@lo:502: 00000100:00100000:0.0:1789042828.130655:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:6687:x1875947267562880:12345-0@lo:502: Request processed in 232us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042828.130662:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789042828.132841:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267562880:0@lo:502: 00000040:00080000:1.0:1789042828.133150:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789042828.133222:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789042828.133257:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267563008:0@lo:502: 00000100:00100000:1.0:1789042828.133316:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042828.133363:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a48252f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789042828.134713:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267563008 00000100:00100000:0.0:1789042828.134724:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267563008 00000100:00100000:0.0:1789042828.134772:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789042828.134781:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:6687:x1875947267563008:12345-0@lo:502: 00000100:00100000:0.0:1789042828.135045:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:6687:x1875947267563008:12345-0@lo:502: Request processed in 264us (1728us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042828.135053:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789042828.135478:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267563008:0@lo:502: 00000040:00080000:1.0:1789042828.136048:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789042828.136062:0:6687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789042828.149220:0:6710:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789042828.149234:0:6710:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789042828.149236:0:6710:0:(obd_config.c:1661:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789042828.149242:0:6710:0:(obd_config.c:2102:class_config_llog_handler()) cmd ce032, instance name: general-ffffa06a7924c000 00000020:00000080:1.0:1789042828.149244:0:6710:0:(obd_config.c:1570:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789042828.149265:0:6710:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789042828.149268:0:6710:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789042828.149269:0:6710:0:(obd_config.c:1661:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789042828.149273:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789042828.149459:0:6687:0:(obd_config.c:2243:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789042828.149482:0:6687:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789042828.149504:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05cfb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05d02 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042828.149540:0:6687:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05cfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05d02 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789042828.149579:0:6687:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789042828.149582:0:6687:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa06a7924c000 10000000:01000000:0.0:1789042828.149586:0:6687:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa06a7924c000 10000000:01000000:0.0:1789042828.149599:0:6687:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789042828.149606:0:6687:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa06a7924c000 from 1 10000000:01000000:0.0:1789042828.149609:0:6687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789042828.149644:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a40030e00/0x99260d7389c05d09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042828.149652:0:6687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a40030e00/0x99260d7389c05d09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042828.149663:0:6687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a40030e00/0x99260d7389c05d09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042828.149985:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a520c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267563136:0@lo:101: 00000100:00100000:0.0:1789042828.150053:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042828.150094:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267563136 00000100:00100000:0.0:1789042828.150114:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267563136 00000100:00100000:0.0:1789042828.150153:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789042828.150161:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:6687:x1875947267563136:12345-0@lo:101: 00010000:00010000:0.0:1789042828.150174:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789042828.150187:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a40031400/0x99260d7389c05d10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05d09 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042828.150218:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a40031400/0x99260d7389c05d10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05d09 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042828.150230:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a40031400/0x99260d7389c05d10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05d09 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042828.150238:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a40031400, rc 0) 00000100:00100000:0.0:1789042828.150271:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:6687:x1875947267563136:12345-0@lo:101: Request processed in 110us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042828.150277:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789042828.150319:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a45384b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789042828.150349:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a520c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267563136:0@lo:101: 00010000:00010000:0.0:1789042828.150364:0:6687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a40030e00/0x99260d7389c05d09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05d10 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042828.150372:0:6687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a40030e00/0x99260d7389c05d09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05d10 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042828.150453:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a520c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267563264:0@lo:501: 00000100:00100000:0.0:1789042828.150478:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042828.150501:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a45384b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789042828.150692:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267563264 00000100:00100000:3.0:1789042828.150698:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267563264 00000100:00100000:3.0:1789042828.150729:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789042828.150737:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:6687:x1875947267563264:12345-0@lo:501: 00000100:00100000:3.0:1789042828.150960:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:6687:x1875947267563264:12345-0@lo:501: Request processed in 224us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042828.150967:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789042828.151097:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a520c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267563264:0@lo:501: 00000100:00100000:0.0:1789042828.151132:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a520c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267563392:0@lo:503: 00000100:00100000:0.0:1789042828.151169:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042828.151190:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267563392 00000100:00100000:0.0:1789042828.151194:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267563392 00000100:00100000:0.0:1789042828.151231:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789042828.151238:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:6687:x1875947267563392:12345-0@lo:503: 00000100:00100000:0.0:1789042828.151379:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:6687:x1875947267563392:12345-0@lo:503: Request processed in 141us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042828.151386:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789042828.151421:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a45384b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789042828.151433:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a520c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267563392:0@lo:503: 00000040:00080000:0.0:1789042828.153922:0:6687:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789042828.154011:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a520c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267563520:0@lo:502: 00000100:00100000:0.0:1789042828.154069:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042828.154103:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267563520 00000100:00100000:0.0:1789042828.154109:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267563520 00000100:00100000:0.0:1789042828.154145:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789042828.154153:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:6687:x1875947267563520:12345-0@lo:502: 00000100:00100000:0.0:1789042828.154544:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:6687:x1875947267563520:12345-0@lo:502: Request processed in 390us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042828.154551:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789042828.154609:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a45384b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789042828.154631:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a520c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267563520:0@lo:502: 00000040:00080000:0.0:1789042828.155196:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789042828.155258:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789042828.155290:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789042828.155356:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789042828.155395:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789042828.155445:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789042828.155482:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789042828.156762:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789042828.156847:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789042828.156885:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789042828.156915:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789042828.156958:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789042828.156993:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789042828.157026:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789042828.157073:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789042828.157111:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789042828.157142:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789042828.157189:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789042828.157873:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789042828.157916:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789042828.157970:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789042828.158011:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789042828.158043:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789042828.158086:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789042828.158145:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1789042828.158181:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1789042828.158249:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1789042828.158306:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1789042828.159466:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267563648:0@lo:502: 00000100:00100000:1.0:1789042828.159562:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042828.160406:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a48252540 going to sleep for 11 seconds 00000100:00100000:0.0:1789042828.160496:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267563648 00000100:00100000:0.0:1789042828.160504:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267563648 00000100:00100000:2.0:1789042828.160756:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789042828.160768:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:6687:x1875947267563648:12345-0@lo:502: 00000100:00100000:2.0:1789042828.161007:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:6687:x1875947267563648:12345-0@lo:502: Request processed in 242us (1445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042828.161015:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789042828.161129:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267563648:0@lo:502: 00000040:00080000:1.0:1789042828.161246:0:6687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1789042828.161262:0:6687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1789042828.163073:0:6711:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789042828.163090:0:6711:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffffa06a52ca4d88) 00000020:00000080:3.0:1789042828.163111:0:6711:0:(obd_config.c:786:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1789042828.163301:0:6711:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa06a7924c000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789042828.163307:0:6711:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa06a7924c000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789042828.163316:0:6711:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa06a7924c000 3 00010000:00080000:3.0:1789042828.163417:0:6711:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa069412fd800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.117@tcp at head 00010000:00010000:3.0:1789042828.167021:0:6711:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1789042828.167444:0:6711:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789042828.167479:0:6711:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789042828.167492:0:6711:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x99260d7389c05d1e 00000100:00080000:3.0:1789042828.167502:0:6711:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789042828.167508:0:6711:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffffa069412fd800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:3.0:1789042828.167562:0:6711:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa06a7a027b80 x1875947267563776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789042828.167635:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875947267563776:0@lo:38: 00000100:00100000:0.0:1789042828.168368:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042828.168484:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267563776 00000100:00100000:2.0:1789042828.168492:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267563776 00000100:00100000:2.0:1789042828.168549:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789042828.168556:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a520c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3311:x1875947267563776:12345-0@lo:38: 00010000:00080000:2.0:1789042828.168580:0:5846:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 171 last 0 00000020:00000080:2.0:1789042828.168622:0:5846:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x99260d7389c05d25 00000004:00100000:2.0:1789042828.168636:0:5846:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789042828.168667:0:5846:0:(import.c:65:import_set_state_nolock()) ffffa06941217800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1789042828.170678:0:6711:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789042828.171043:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789042828.171059:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875947267563904:0@lo:400: 00000100:00100000:1.0:1789042828.171114:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042828.171159:0:5845:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789042828.171168:0:5845:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789042828.172457:0:5847:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789042828.172472:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267563904 00000100:00100000:3.0:1789042828.172479:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267563904 00000100:00100000:3.0:1789042828.172530:0:5847:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789042828.172541:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789042828.172550:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875947267563904:12345-0@lo:400: 00000100:00100000:3.0:1789042828.172629:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875947267563904:12345-0@lo:400: Request processed in 81us (1514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042828.172637:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789042828.172932:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa06a7a8b4e00 x1875947267563904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789042844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789042828.172947:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875947267563904:0@lo:400: 00000100:00100000:2.0:1789042828.173850:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a520c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875947267563776:12345-0@lo:38: Request processed in 5289us (5479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042828.173859:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:2.0:1789042828.177276:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1789042828.177820:0:6687:0:(obd_config.c:2243:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1789042828.177916:0:6687:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789042828.177932:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a40030e00/0x99260d7389c05d09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05d10 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042828.177944:0:6687:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a40030e00/0x99260d7389c05d09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05d10 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789042828.177995:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789042828.177998:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789042828.177999:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789042828.178005:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789042828.178006:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789042828.178007:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789042828.178009:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789042828.178010:0:6687:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789042828.178011:0:6687:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789042828.178013:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789042828.178014:0:6687:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789042828.178017:0:6687:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1789042828.178020:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789042828.178021:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789042828.178022:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789042828.178023:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789042828.178023:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789042828.178024:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789042828.178025:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789042828.178026:0:6687:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789042828.178027:0:6687:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789042828.178027:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789042828.178028:0:6687:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789042828.178053:0:6687:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789042828.178070:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267564032:0@lo:253: 00000100:00100000:1.0:1789042828.178137:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042828.178177:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a48252f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789042828.178872:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267564032 00000100:00100000:3.0:1789042828.178881:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267564032 00000100:00100000:3.0:1789042828.178922:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789042828.178930:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:6687:x1875947267564032:12345-0@lo:253: 20000000:01000000:3.0:1789042828.178969:0:5839:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789042828.178982:0:5839:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:0.0:1789042828.180843:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa06a7a027b80 x1875947267563776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789042838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042828.180859:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789042828.180868:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1789042828.180876:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789042828.180881:0:3311:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789042828.180885:0:3311:0:(import.c:65:import_set_state_nolock()) ffffa069412fd800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789042828.180892:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875947267563776:0@lo:38: 20000000:01000000:3.0:1789042828.291845:0:5839:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789042828.291864:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789042828.294295:0:5861:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789042828.294304:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789042828.294483:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa06a58604c00/0x99260d7389c05d2c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042828.294503:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a40031a00/0x99260d7389c05c8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05c84 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042828.294539:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa06a58604c00/0x99260d7389c05d2c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042828.294711:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a40031a00/0x99260d7389c05c8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99260d7389c05c84 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042828.294725:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa06a40031a00/0x99260d7389c05c8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99260d7389c05c84 expref: 13 pid: 5841 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042828.294740:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75edca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1875947267564160:0@lo:104: 00000100:00100000:2.0:1789042828.294810:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042828.294849:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a453f8240 going to sleep for 11 seconds 00000100:00100000:1.0:1789042828.295469:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267564160 00000100:00100000:1.0:1789042828.295488:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267564160 00000100:00100000:1.0:1789042828.295562:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789042828.296007:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75edf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+3:5861:x1875947267564160:12345-0@lo:104: 00010000:00010000:1.0:1789042828.296023:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffffa06a58604000/0x99260d7389c05c84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05c8b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042828.296095:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789042828.296101:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75edf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+3:5861:x1875947267564160:12345-0@lo:104: Request processed in 531us (1292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042828.296109:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1789042828.296177:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789042828.296184:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a58604000/0x99260d7389c05c84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05c8b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042828.296198:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a58604000 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:0.0:1789042828.296202:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a58604000/0x99260d7389c05c84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x99260d7389c05c8b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042828.296219:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a58604000/0x99260d7389c05c84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x99260d7389c05c8b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789042828.296226:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a58604000/0x99260d7389c05c84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x99260d7389c05c8b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789042828.296231:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789042828.296268:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a58604000/0x99260d7389c05c84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05c8b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042828.296276:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789042828.296293:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a58604000/0x99260d7389c05c84 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05c8b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042828.296300:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a58604000/0x99260d7389c05c84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05c8b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042828.296325:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789042828.296327:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789042828.296335:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789042828.297028:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a520c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267564288:0@lo:103: 00000100:00100000:1.0:1789042828.297071:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042828.297157:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267564288 00000100:00100000:0.0:1789042828.297164:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267564288 00010000:00010000:0.0:1789042828.297188:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a40031a00/0x99260d7389c05c8b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05c84 expref: 14 pid: 5841 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042828.297224:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789042828.297239:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a55f65c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+14:3313:x1875947267564288:12345-0@lo:103: 00010000:00010000:0.0:1789042828.297263:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789042828.297269:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a40031a00/0x99260d7389c05c8b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05c84 expref: 14 pid: 5841 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042828.297279:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a40031a00/0x99260d7389c05c8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99260d7389c05c84 expref: 14 pid: 5841 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042828.297298:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa06a58604c00/0x99260d7389c05d2c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042828.297315:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a58604c00/0x99260d7389c05d2c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789042828.297338:0:5832:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003035399s 00010000:00010000:0.0:1789042828.297493:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa06a58604c00/0x99260d7389c05d2c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042828.297502:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa06a58604c00/0x99260d7389c05d2c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042828.297509:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa06a58604c00/0x99260d7389c05d2c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042828.297539:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa06a58604c00/0x99260d7389c05d2c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042828.297546:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a58604c00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789042828.297550:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa06a58604c00/0x99260d7389c05d2c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042828.297576:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa06a58604c00/0x99260d7389c05d2c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042828.297711:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa06a58604c00/0x99260d7389c05d2c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042828.297721:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789042828.297756:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a55f65c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+14:3313:x1875947267564288:12345-0@lo:103: Request processed in 517us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042828.297763:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789042828.298026:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a520c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267564288:0@lo:103: 00010000:00010000:2.0:1789042828.298105:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a40031a00/0x99260d7389c05c8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99260d7389c05c84 expref: 13 pid: 5841 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042828.298118:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75edca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1875947267564160:0@lo:104: 00010000:00010000:2.0:1789042828.298131:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa06a58604c00/0x99260d7389c05d2c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042828.298140:0:5861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa06a58604c00/0x99260d7389c05d2c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042828.298146:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa06a58604c00/0x99260d7389c05d2c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042828.298152:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a58604c00/0x99260d7389c05d2c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042828.310232:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:6687:x1875947267564032:12345-0@lo:253: Request processed in 131293us (132085us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042828.310245:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789042828.310480:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6687:1875947267564032:0@lo:253: 10000000:01000000:1.0:1789042828.310495:0:6687:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789042828.310498:0:6687:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789042828.310500:0:6687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789042828.310501:0:6687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789042828.310502:0:6687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789042828.310504:0:6687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789042828.310505:0:6687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789042828.310506:0:6687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789042828.310508:0:6687:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789042828.310509:0:6687:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789042828.310511:0:6687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789042828.310739:0:6687:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789042828.310756:0:6687:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789042828.318829:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789042828.319080:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789042828.319300:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789042828.320000:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789042828.320233:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789042828.320799:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789042828.322870:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1789042828.643977:0:6687:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789042828.643984:0:6687:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789042828.644014:0:6687:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789042828.644067:0:6687:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.117@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789042828.644083:0:6687:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789042828.644108:0:6687:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1789042828.659043:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789042829.056003:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789042829.056022:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa06a52b8e800 from 21 10000000:01000000:2.0:1789042829.056027:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789042829.056067:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a58605200/0x99260d7389c05d33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042829.056079:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a58605200/0x99260d7389c05d33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042829.056091:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a58605200/0x99260d7389c05d33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042829.056113:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75edca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267564416:0@lo:101: 00000100:00100000:2.0:1789042829.056175:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042829.056238:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa069411ef180 going to sleep for 11 seconds 00000100:00100000:3.0:1789042829.057068:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267564416 00000100:00100000:3.0:1789042829.057085:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267564416 00000100:00100000:3.0:1789042829.057131:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789042829.057142:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:5844:x1875947267564416:12345-0@lo:101: 00010000:00010000:3.0:1789042829.057155:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789042829.057170:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a429f4a00/0x99260d7389c05d3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05d33 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042829.057194:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a429f4a00/0x99260d7389c05d3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05d33 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042829.057217:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a429f4a00/0x99260d7389c05d3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05d33 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042829.057226:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a429f4a00, rc 0) 00000100:00100000:3.0:1789042829.057302:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:5844:x1875947267564416:12345-0@lo:101: Request processed in 163us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042829.057309:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789042829.057368:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75edca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267564416:0@lo:101: 00010000:00010000:3.0:1789042829.057383:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a58605200/0x99260d7389c05d33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05d3a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042829.057392:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a58605200/0x99260d7389c05d33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05d3a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042829.057452:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a025180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267564544:0@lo:501: 00000100:00100000:3.0:1789042829.057478:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042829.057496:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a51814a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789042829.057509:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267564544 00000100:00100000:3.0:1789042829.057528:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267564544 00000100:00100000:3.0:1789042829.057557:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789042829.057563:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:5844:x1875947267564544:12345-0@lo:501: 00000100:00100000:3.0:1789042829.069886:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:5844:x1875947267564544:12345-0@lo:501: Request processed in 12315us (12400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042829.069899:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789042829.070112:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a025180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267564544:0@lo:501: 00000100:00100000:1.0:1789042829.070163:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267564672:0@lo:503: 00000100:00100000:1.0:1789042829.070221:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042829.070328:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7608a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789042829.071050:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267564672 00000100:00100000:3.0:1789042829.071058:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267564672 00000100:00100000:3.0:1789042829.071099:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789042829.071108:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:5844:x1875947267564672:12345-0@lo:503: 00000100:00100000:3.0:1789042829.071771:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:5844:x1875947267564672:12345-0@lo:503: Request processed in 662us (1548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042829.071780:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789042829.071842:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267564672:0@lo:503: 00000100:00100000:2.0:1789042829.082893:0:6734:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75edc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6734:1875947267564800:0@lo:502: 00000100:00100000:2.0:1789042829.082981:0:6734:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042829.083020:0:6734:0:(client.c:2716:ptlrpc_set_wait()) set ffffa069411efd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789042829.083181:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267564800 00000100:00100000:0.0:1789042829.083189:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267564800 00000100:00100000:0.0:1789042829.083240:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789042829.083260:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:6734:x1875947267564800:12345-0@lo:502: 00000100:00100000:0.0:1789042829.102154:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:6734:x1875947267564800:12345-0@lo:502: Request processed in 18897us (19164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042829.102167:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789042829.102244:0:6734:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75edc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6734:1875947267564800:0@lo:502: 00000100:00100000:0.0:1789042829.102479:0:6734:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a520c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6734:1875947267564928:0@lo:502: 00000100:00100000:0.0:1789042829.102537:0:6734:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042829.102565:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267564928 00000100:00100000:0.0:1789042829.102572:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267564928 00000100:00100000:0.0:1789042829.103447:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789042829.103457:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:6734:x1875947267564928:12345-0@lo:502: 00000100:00100000:0.0:1789042829.103784:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:6734:x1875947267564928:12345-0@lo:502: Request processed in 328us (1246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042829.103801:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789042829.103849:0:6734:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a505a06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789042829.103864:0:6734:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a520c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6734:1875947267564928:0@lo:502: 00000040:00080000:0.0:1789042829.103887:0:6734:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1789042829.109062:0:5844:0:(obd_config.c:2243:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1789042829.109094:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789042829.109105:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a58605200/0x99260d7389c05d33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05d3a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042829.109119:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a58605200/0x99260d7389c05d33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05d3a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789042829.109173:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789042829.109176:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa06a52b8e800 from 4 10000000:01000000:3.0:1789042829.109180:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789042829.109236:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a429f5600/0x99260d7389c05d41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042829.109245:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a429f5600/0x99260d7389c05d41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042829.110663:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a429f5600/0x99260d7389c05d41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042829.111010:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a026d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267565056:0@lo:101: 00000100:00100000:3.0:1789042829.111073:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042829.111891:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a518146c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789042829.115837:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267565056 00000100:00100000:0.0:1789042829.115851:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267565056 00000100:00100000:0.0:1789042829.115908:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789042829.115918:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:5844:x1875947267565056:12345-0@lo:101: 00010000:00010000:0.0:1789042829.115941:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789042829.115960:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a40031c00/0x99260d7389c05d48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05d41 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042829.115987:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a40031c00/0x99260d7389c05d48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05d41 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042829.115997:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a40031c00/0x99260d7389c05d48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05d41 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042829.116006:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a40031c00, rc 0) 00000100:00100000:0.0:1789042829.116069:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+14:5844:x1875947267565056:12345-0@lo:101: Request processed in 153us (4997us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042829.116075:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789042829.116124:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a026d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267565056:0@lo:101: 00010000:00010000:0.0:1789042829.116139:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a429f5600/0x99260d7389c05d41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05d48 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042829.116148:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a429f5600/0x99260d7389c05d41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05d48 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042829.116228:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a520c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267565184:0@lo:256: 00000100:00100000:0.0:1789042829.116271:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042829.116296:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a505a0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789042829.116310:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267565184 00000100:00100000:0.0:1789042829.116313:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267565184 00000100:00100000:0.0:1789042829.116332:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789042829.117369:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+14:5844:x1875947267565184:12345-0@lo:256: 20000000:01000000:0.0:1789042829.117385:0:5839:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789042829.117401:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789042829.117404:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1789042829.117483:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+14:5844:x1875947267565184:12345-0@lo:256: Request processed in 119us (1210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042829.124482:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789042829.135926:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a520c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267565184:0@lo:256: 10000000:01000000:0.0:1789042829.136439:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789042829.136449:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a429f5600/0x99260d7389c05d41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05d48 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042829.136462:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a429f5600/0x99260d7389c05d41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05d48 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789042829.136471:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789042829.136474:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1789042829.136477:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789042829.136853:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05d4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042829.136875:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05d4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042829.136884:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05d4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042829.136901:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a520c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267565312:0@lo:101: 00000100:00100000:0.0:1789042829.136965:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042829.137012:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a505a0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789042829.137036:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267565312 00000100:00100000:0.0:1789042829.137042:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267565312 00000100:00100000:0.0:1789042829.137081:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789042829.137088:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a472e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+14:5844:x1875947267565312:12345-0@lo:101: 00010000:00010000:0.0:1789042829.137100:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789042829.137112:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a40031600/0x99260d7389c05d56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05d4f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042829.137132:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a40031600/0x99260d7389c05d56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05d4f expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042829.137141:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a40031600/0x99260d7389c05d56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05d4f expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042829.137149:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a40031600, rc 0) 00000100:00100000:0.0:1789042829.137180:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a472e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:5844:x1875947267565312:12345-0@lo:101: Request processed in 92us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042829.137186:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789042829.137222:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a520c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267565312:0@lo:101: 00010000:00010000:0.0:1789042829.137240:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05d4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05d56 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042829.137258:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05d4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05d56 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042829.137300:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a520c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267565440:0@lo:501: 00000100:00100000:0.0:1789042829.137325:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042829.137332:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a505a0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789042829.137357:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267565440 00000100:00100000:0.0:1789042829.137360:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267565440 00000100:00100000:0.0:1789042829.137373:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789042829.137377:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a472e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:5844:x1875947267565440:12345-0@lo:501: 00000100:00100000:0.0:1789042829.139977:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a472e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:5844:x1875947267565440:12345-0@lo:501: Request processed in 2590us (2644us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042829.139989:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789042829.142089:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a520c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267565440:0@lo:501: 00000100:00100000:2.0:1789042829.153758:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75ede300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267565568:0@lo:503: 00000100:00100000:2.0:1789042829.153836:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042829.153886:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa069411ef3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789042829.155647:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267565568 00000100:00100000:0.0:1789042829.155659:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267565568 00000100:00100000:0.0:1789042829.155723:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789042829.155733:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46e5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:5844:x1875947267565568:12345-0@lo:503: 00000100:00100000:0.0:1789042829.156107:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46e5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:5844:x1875947267565568:12345-0@lo:503: Request processed in 374us (2270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042829.156116:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789042829.158469:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75ede300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267565568:0@lo:503: 00000100:00100000:0.0:1789042829.160430:0:6736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a520c2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6736:1875947267565696:0@lo:502: 00000100:00100000:0.0:1789042829.160504:0:6736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042829.160649:0:6736:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a505a00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789042829.172386:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267565696 00000100:00100000:2.0:1789042829.172402:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267565696 00000100:00100000:2.0:1789042829.172482:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789042829.172492:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46e5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:6736:x1875947267565696:12345-0@lo:502: 00000100:00100000:2.0:1789042829.173133:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46e5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:6736:x1875947267565696:12345-0@lo:502: Request processed in 641us (12627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042829.173143:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789042829.173359:0:6736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a520c2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6736:1875947267565696:0@lo:502: 00000020:01000000:0.0:1789042829.173398:0:6736:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789042829.173405:0:6736:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789042829.173412:0:6736:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789042829.173414:0:6736:0:(obd_config.c:1661:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789042829.173419:0:6736:0:(obd_config.c:1570:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789042829.173423:0:6736:0:(obd_config.c:1585:class_process_config()) adding mapping from uuid 192.168.203.117@tcp to nid 0x20000c0a8cb75 (192.168.203.117@tcp) 00000020:01000000:0.0:1789042829.173445:0:6736:0:(obd_config.c:2072:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789042829.173448:0:6736:0:(obd_config.c:1570:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789042829.173464:0:6736:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffffa06a47340000) 00000020:00000080:0.0:1789042829.173485:0:6736:0:(obd_config.c:786:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1789042829.173490:0:6736:0:(obd_config.c:1570:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789042829.173617:0:6736:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789042829.173623:0:6736:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789042829.173630:0:6736:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x99260d7389c05d64 00010000:00080000:0.0:1789042829.173658:0:6736:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa06a52b66000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.117@tcp at head 00010000:00010000:0.0:1789042829.173885:0:6736:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1789042829.285426:0:6736:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789042829.285448:0:6736:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789042829.291481:0:6736:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789042829.293643:0:6736:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789042829.293706:0:6736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1789042829.293771:0:6736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1789042829.294583:0:6741:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789042829.294589:0:6741:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789042829.300823:0:6736:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789042829.300838:0:6736:0:(obd_config.c:1570:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789042829.300875:0:6736:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789042829.300896:0:6736:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x99260d7389c05d6b 00000100:00080000:1.0:1789042829.300906:0:6736:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789042829.300918:0:6736:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa06a52b66000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:1.0:1789042829.301442:0:6736:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa06a7a8b7b80 x1875947267565824/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789042829.301467:0:6736:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1789042829.301831:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875947267565824:0@lo:8: 00000100:00100000:0.0:1789042829.301897:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042829.302085:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267565824 00000100:00100000:0.0:1789042829.302094:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267565824 00000100:00100000:0.0:1789042829.302125:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789042829.302133:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a520c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3311:x1875947267565824:12345-0@lo:8: 00010000:00080000:0.0:1789042829.302156:0:6690:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:0.0:1789042829.302178:0:6690:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x99260d7389c05d72 00002000:00100000:0.0:1789042829.302448:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffffa06a52b60000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789042829.302453:0:6690:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1789042829.302458:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1789042829.302767:0:6690:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789042829.302910:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789042829.302998:0:6690:0:(import.c:65:import_set_state_nolock()) ffffa06a52b61000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789042829.303056:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a520c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1875947267565824:12345-0@lo:8: Request processed in 922us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042829.303080:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789042829.303106:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a520c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267565952:0@lo:400: 00000100:00100000:0.0:1789042829.303133:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042829.303155:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789042829.303160:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a520c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267566080:0@lo:400: 00000100:00100000:0.0:1789042829.303178:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789042829.303389:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a7a8b7b80 x1875947267565824/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789042839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042829.303400:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789042829.303407:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789042829.303414:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789042829.303419:0:3311:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789042829.303422:0:3311:0:(import.c:65:import_set_state_nolock()) ffffa06a52b66000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789042829.304132:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267565952 00000100:00100000:0.0:1789042829.304139:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267565952 00000100:00100000:0.0:1789042829.304177:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267566080 00000100:00100000:0.0:1789042829.304181:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267566080 00000100:00100000:0.0:1789042829.304224:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789042829.304231:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a520c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267565952:12345-0@lo:400: 00000100:00100000:0.0:1789042829.304289:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a520c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267565952:12345-0@lo:400: Request processed in 58us (1154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042829.304295:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789042829.304308:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789042829.304314:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a520c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267566080:12345-0@lo:400: 00000100:00100000:0.0:1789042829.304446:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a520c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267566080:12345-0@lo:400: Request processed in 131us (1266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042829.304452:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789042829.304619:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789042829.304647:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a520c0700 x1875947267566080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789042845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042829.304659:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a520c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267566080:0@lo:400: 00010000:00080000:0.0:1789042829.304679:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a520c1180 x1875947267565952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789042845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042829.304687:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a520c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267565952:0@lo:400: 00000020:01000000:1.0:1789042829.304996:0:6736:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789042829.305003:0:6736:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789042829.305005:0:6736:0:(obd_config.c:1661:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789042829.305009:0:6736:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789042829.305013:0:6736:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789042829.305015:0:6736:0:(obd_config.c:1661:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789042829.305018:0:6736:0:(obd_config.c:1570:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789042829.305020:0:6736:0:(obd_config.c:1635:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789042829.305050:0:6736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6736:1875947267566208:0@lo:502: 00000100:00100000:1.0:1789042829.305097:0:6736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042829.305134:0:6736:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a4612e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789042829.305261:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267566208 00000100:00100000:3.0:1789042829.305267:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267566208 00000100:00100000:3.0:1789042829.305309:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789042829.305317:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46e5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:6736:x1875947267566208:12345-0@lo:502: 00000100:00100000:3.0:1789042829.305692:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46e5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:6736:x1875947267566208:12345-0@lo:502: Request processed in 375us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042829.305699:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789042829.305786:0:6736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:6736:1875947267566208:0@lo:502: 00000020:01000000:1.0:1789042829.305808:0:6736:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789042829.305813:0:6736:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789042829.305815:0:6736:0:(obd_config.c:1661:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789042829.305820:0:6736:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1789042829.305952:0:5844:0:(obd_config.c:2243:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1789042829.305968:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789042829.305978:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05d4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05d56 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042829.305989:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05d4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05d56 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789042829.305999:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789042829.306001:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffffa06a5209cd88 from 1 10000000:01000000:3.0:1789042829.306004:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789042829.306026:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a429f4c00/0x99260d7389c05d79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042829.306043:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a429f4c00/0x99260d7389c05d79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042829.306052:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a429f4c00/0x99260d7389c05d79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042829.306066:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a024a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267566336:0@lo:101: 00000100:00100000:3.0:1789042829.306092:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042829.306122:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a518143c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789042829.306223:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267566336 00000100:00100000:1.0:1789042829.306228:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267566336 00000100:00100000:1.0:1789042829.306266:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789042829.306274:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46e5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:5844:x1875947267566336:12345-0@lo:101: 00010000:00010000:1.0:1789042829.306283:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789042829.306295:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a41686200/0x99260d7389c05d80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05d79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042829.306482:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a41686200/0x99260d7389c05d80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05d79 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042829.306499:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a41686200/0x99260d7389c05d80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05d79 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042829.306508:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41686200, rc 0) 00000100:00100000:1.0:1789042829.306573:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46e5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:5844:x1875947267566336:12345-0@lo:101: Request processed in 299us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042829.306579:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789042829.306608:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a024a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267566336:0@lo:101: 00010000:00010000:1.0:1789042829.306620:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a429f4c00/0x99260d7389c05d79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05d80 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042829.306627:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a429f4c00/0x99260d7389c05d79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05d80 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042829.306667:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267566464:0@lo:501: 00000100:00100000:1.0:1789042829.306690:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042829.306703:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a44d1f780 going to sleep for 11 seconds 00000100:00100000:1.0:1789042829.306715:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267566464 00000100:00100000:1.0:1789042829.306718:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267566464 00000100:00100000:1.0:1789042829.306738:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789042829.306744:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43887850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:5844:x1875947267566464:12345-0@lo:501: 00000100:00100000:1.0:1789042829.306915:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43887850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:5844:x1875947267566464:12345-0@lo:501: Request processed in 170us (223us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789042829.306921:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789042829.307016:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267566464:0@lo:501: 10000000:01000000:1.0:1789042829.307035:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789042829.307046:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a429f4c00/0x99260d7389c05d79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05d80 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042829.307053:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a429f4c00/0x99260d7389c05d79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05d80 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789042829.315642:0:3311:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789042829.315659:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875947267565824:0@lo:8: 00000004:00080000:1.0:1789042829.322549:0:6741:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789042829.323910:0:6741:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 172280393460ns, next at 0ns, rc = 0 00000004:00080000:0.0:1789042829.407853:0:6742:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789042829.407885:0:6742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a520c0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6742:1875947267566720:0@lo:7: 00000100:00100000:0.0:1789042829.407947:0:6742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042829.407991:0:6742:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a52c9c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789042829.408013:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a520c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267566592:0@lo:13: 00000100:00100000:0.0:1789042829.408039:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042829.408075:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267566720 00000100:00100000:0.0:1789042829.408082:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267566720 00000100:00100000:0.0:1789042829.408131:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789042829.408140:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a520c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6742:x1875947267566720:12345-0@lo:7: 00000100:00080000:2.0:1789042829.415589:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789042829.415616:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267566592 00000100:00100000:2.0:1789042829.415626:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267566592 00000100:00100000:2.0:1789042829.415684:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789042829.415695:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a520c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875947267566592:12345-0@lo:13: 00002000:00000024:2.0:1789042829.415728:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00100000:2.0:1789042829.415808:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a520c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875947267566592:12345-0@lo:13: Request processed in 114us (7766us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042829.415815:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00002000:00080000:0.0:1789042829.430650:0:6692:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1789042829.430660:0:6692:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1789042829.430762:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a520c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6742:x1875947267566720:12345-0@lo:7: Request processed in 22620us (22811us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042829.430773:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789042829.430847:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a520c1180 x1875947267566592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042845 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042829.430870:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a520c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267566592:0@lo:13: 00010000:00080000:0.0:1789042829.430903:0:6742:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a520c0700 x1875947267566720/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789042845 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042829.430912:0:6742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a520c0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6742:1875947267566720:0@lo:7: 00000004:00080000:0.0:1789042829.430921:0:6742:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1789042829.430965:0:6742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a520c0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6742:1875947267566848:0@lo:5: 00000100:00100000:0.0:1789042829.430995:0:6742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042829.431027:0:6742:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a52c9c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789042829.431043:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267566848 00000100:00100000:0.0:1789042829.431049:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267566848 00000100:00100000:0.0:1789042829.431084:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789042829.431093:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a520c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6742:x1875947267566848:12345-0@lo:5: 00002000:00080000:0.0:1789042829.431115:0:6691:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789042829.431119:0:6691:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1789042829.431322:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a520c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6742:x1875947267566848:12345-0@lo:5: Request processed in 229us (326us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789042829.431329:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789042829.431366:0:6742:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a520c0700 x1875947267566848/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789042845 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042829.431378:0:6742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a520c0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6742:1875947267566848:0@lo:5: 00000004:00080000:0.0:1789042829.431385:0:6742:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789042829.431408:0:6742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a520c2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6742:1875947267566976:0@lo:700: 00000100:00100000:0.0:1789042829.431430:0:6742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042829.431448:0:6742:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a52c9c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789042829.431465:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267566976 00000100:00100000:0.0:1789042829.431469:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267566976 00000100:00100000:0.0:1789042829.431491:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789042829.431498:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a520c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6742:x1875947267566976:12345-0@lo:700: 00000100:00100000:0.0:1789042829.431549:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a520c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6698:1875947267567104:0@lo:700: 00000100:00100000:0.0:1789042829.431573:0:6698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042829.431588:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a52c9c300 going to sleep for 11 seconds 00000100:00100000:0.0:1789042829.431623:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267567104 00000100:00100000:0.0:1789042829.431627:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267567104 00000100:00100000:0.0:1789042829.431654:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789042829.431661:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a520c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6698:x1875947267567104:12345-0@lo:700: 00000004:00080000:0.0:1789042829.539150:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:2.0:1789042829.599796:0:5852:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1789042829.619867:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a520c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6698:x1875947267567104:12345-0@lo:700: Request processed in 188199us (188284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042829.619887:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789042829.624155:0:6698:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a520c1c00 x1875947267567104/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789042845 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042829.624174:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a520c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6698:1875947267567104:0@lo:700: 40000000:02000000:3.0:1789042829.624186:0:6698:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00010000:00010000:3.0:1789042829.694591:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789042829.788060:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1789042829.788079:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789042829.789006:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a520c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6742:x1875947267566976:12345-0@lo:700: Request processed in 357503us (357568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042829.789023:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789042829.792387:0:6742:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a520c2d80 x1875947267566976/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789042845 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042829.792402:0:6742:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789042829.792420:0:6742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a520c2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6742:1875947267566976:0@lo:700: 00000004:02000040:0.0:1789042829.896587:0:6742:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1789042829.914742:0:6742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6742:1875947267567232:0@lo:5: 00000100:00100000:1.0:1789042829.914911:0:6742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042829.915641:0:6742:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a44d1f540 going to sleep for 11 seconds 00000100:00100000:0.0:1789042829.915941:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267567232 00000100:00100000:0.0:1789042829.915949:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267567232 00000100:00100000:0.0:1789042829.916002:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789042829.916012:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6742:x1875947267567232:12345-0@lo:5: 00002000:00080000:2.0:1789042829.940238:0:6692:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1789042829.941782:0:6692:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1789042829.967885:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6742:x1875947267567232:12345-0@lo:5: Request processed in 51863us (52962us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789042829.967904:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789042829.978811:0:6742:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a7a8b5500 x1875947267567232/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789042845 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042829.978831:0:6742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6742:1875947267567232:0@lo:5: 00000004:00080000:2.0:1789042829.978848:0:6742:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1789042830.711275:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789042831.733293:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789042832.754758:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789042833.789933:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789042834.681371:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267567360:0@lo:13: 00000100:00100000:3.0:1789042834.681444:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042834.681669:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267567360 00000100:00100000:2.0:1789042834.681678:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267567360 00000100:00100000:2.0:1789042834.681745:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789042834.681755:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875947267567360:12345-0@lo:13: 00002000:00000024:2.0:1789042834.681789:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789042834.681833:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875947267567360:12345-0@lo:13: Request processed in 80us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042834.681841:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789042834.681906:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789042834.681940:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a75ede300 x1875947267567360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042850 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042834.681961:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267567360:0@lo:13: 00000100:00100000:0.0:1789042834.686994:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a520c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875947267567744:0@lo:400: 00000100:00100000:0.0:1789042834.687056:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042834.687097:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a520c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875947267567616:0@lo:400: 00000100:00100000:0.0:1789042834.687117:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042834.687131:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789042834.687136:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a520c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3315:1875947267567488:0@lo:400: 00000100:00100000:0.0:1789042834.687175:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042834.689012:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267567744 00000100:00100000:1.0:1789042834.689028:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267567744 00000100:00100000:1.0:1789042834.689099:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267567616 00000100:00100000:1.0:1789042834.689103:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267567616 00000100:00100000:1.0:1789042834.689130:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789042834.689140:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a520c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875947267567744:12345-0@lo:400: 00000100:00100000:1.0:1789042834.689244:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a520c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875947267567744:12345-0@lo:400: Request processed in 106us (2187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042834.689253:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789042834.689270:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789042834.689277:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a520c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875947267567616:12345-0@lo:400: 00000100:00100000:1.0:1789042834.689314:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a520c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875947267567616:12345-0@lo:400: Request processed in 37us (2195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042834.689333:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1789042834.692581:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789042834.697799:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a520c3100 x1875947267567744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789042850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042834.697816:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a520c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875947267567744:0@lo:400: 00000100:00100000:3.0:1789042834.699998:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267567488 00000100:00100000:3.0:1789042834.700013:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267567488 00000100:00100000:3.0:1789042834.700069:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789042834.700079:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43886450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:3315:x1875947267567488:12345-0@lo:400: 00000100:00100000:3.0:1789042834.700179:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43886450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:3315:x1875947267567488:12345-0@lo:400: Request processed in 86us (12999us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042834.700187:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789042834.705424:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a520c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3315:1875947267567488:0@lo:400: 00010000:00080000:0.0:1789042834.705486:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a520c0700 x1875947267567616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789042850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042834.705499:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a520c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875947267567616:0@lo:400: 00010000:00010000:1.0:1789042834.802719:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789042834.814824:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1789042835.827675:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789042836.053047:0:7059:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789042836.851634:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789042837.884100:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789042838.899530:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789042839.794746:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789042839.794777:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267567872:0@lo:13: 00000100:00100000:3.0:1789042839.794863:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042839.794950:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267567872 00000100:00100000:3.0:1789042839.794959:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267567872 00000100:00100000:3.0:1789042839.795020:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789042839.795031:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a026300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267567872:12345-0@lo:13: 00002000:00000024:3.0:1789042839.795071:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789042839.795124:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a026300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267567872:12345-0@lo:13: Request processed in 94us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042839.795143:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789042839.795171:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789042839.795208:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a7a024700 x1875947267567872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042855 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042839.795220:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789042839.795256:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267567872:0@lo:13: 00000100:00100000:2.0:1789042839.813252:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789042839.813298:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75eddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875947267568256:0@lo:400: 00000100:00100000:2.0:1789042839.813410:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042839.813746:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3314:1875947267568000:0@lo:400: 00000100:00100000:0.0:1789042839.813792:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042839.813824:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789042839.813830:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75edc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267568128:0@lo:400: 00000100:00100000:0.0:1789042839.813855:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042839.813994:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267568000 00000100:00100000:2.0:1789042839.814005:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267568000 00000100:00100000:2.0:1789042839.814065:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789042839.814076:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43886850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:3314:x1875947267568000:12345-0@lo:400: 00000100:00100000:2.0:1789042839.814147:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43886850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:3314:x1875947267568000:12345-0@lo:400: Request processed in 72us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042839.814173:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789042839.814237:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3314:1875947267568000:0@lo:400: 00000100:00100000:1.0:1789042839.814816:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267568256 00000100:00100000:1.0:1789042839.814824:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267568256 00000100:00100000:1.0:1789042839.814879:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267568128 00000100:00100000:1.0:1789042839.814882:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267568128 00000100:00100000:1.0:1789042839.814905:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789042839.814913:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75edd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875947267568256:12345-0@lo:400: 00000100:00100000:1.0:1789042839.814970:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75edd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875947267568256:12345-0@lo:400: Request processed in 57us (1559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042839.814977:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789042839.814991:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789042839.814997:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a520c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267568128:12345-0@lo:400: 00000100:00100000:1.0:1789042839.815024:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a520c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267568128:12345-0@lo:400: Request processed in 28us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042839.815029:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1789042839.815102:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789042839.815239:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a75eddf80 x1875947267568256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789042855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042839.815253:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75eddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875947267568256:0@lo:400: 00010000:00080000:2.0:1789042839.815306:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a75edc380 x1875947267568128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789042855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042839.815316:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75edc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267568128:0@lo:400: 00010000:00010000:0.0:1789042839.922954:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789042840.955828:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789042841.971322:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789042843.003961:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789042844.018658:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789042844.914958:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267568384:0@lo:400: 00000100:00100000:1.0:1789042844.915059:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042844.915134:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789042844.915141:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267568768:0@lo:400: 00000100:00100000:1.0:1789042844.915172:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042844.915203:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267568512:0@lo:400: 00000100:00100000:1.0:1789042844.915230:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042844.915262:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789042844.915268:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267568640:0@lo:400: 00000100:00100000:1.0:1789042844.915318:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042844.915356:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267568384 00000100:00100000:1.0:1789042844.915365:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267568384 00000100:00100000:1.0:1789042844.915421:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789042844.915430:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43887050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:3313:x1875947267568384:12345-0@lo:400: 00000100:00100000:1.0:1789042844.915482:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43887050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:3313:x1875947267568384:12345-0@lo:400: Request processed in 53us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042844.915490:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789042844.915751:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267568768 00000100:00100000:1.0:1789042844.915757:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267568768 00000100:00100000:1.0:1789042844.915804:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789042844.915811:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267568768:12345-0@lo:400: 00000100:00100000:1.0:1789042844.915862:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267568768:12345-0@lo:400: Request processed in 51us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042844.915869:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789042844.915889:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267568512 00000100:00100000:1.0:1789042844.915893:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267568512 00000100:00100000:1.0:1789042844.915919:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267568640 00000100:00100000:1.0:1789042844.915922:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267568640 00000100:00100000:1.0:1789042844.915944:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789042844.915951:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267568512:12345-0@lo:400: 00000100:00100000:1.0:1789042844.915987:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267568512:12345-0@lo:400: Request processed in 36us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042844.915994:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789042844.916005:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789042844.916011:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267568640:12345-0@lo:400: 00000100:00100000:1.0:1789042844.916049:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267568640:12345-0@lo:400: Request processed in 38us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042844.916055:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1789042844.916083:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789042844.916090:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789042844.916146:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a7a8b5c00 x1875947267568640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789042860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789042844.916164:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267568640:0@lo:400: 00010000:00080000:1.0:1789042844.916176:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a7a8b6680 x1875947267568512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789042860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789042844.916185:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267568512:0@lo:400: 00010000:00080000:1.0:1789042844.916224:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a7a8b5500 x1875947267568768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789042844.916234:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267568768:0@lo:400: 00000100:00100000:1.0:1789042844.916243:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267568384:0@lo:400: 00000100:00100000:0.0:1789042844.916551:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789042844.916564:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a520c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267568896:0@lo:13: 00000100:00100000:0.0:1789042844.916616:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042844.916800:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267568896 00000100:00100000:3.0:1789042844.916806:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267568896 00000100:00100000:3.0:1789042844.916901:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789042844.916911:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a520c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267568896:12345-0@lo:13: 00002000:00000024:3.0:1789042844.916949:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789042844.916999:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a520c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267568896:12345-0@lo:13: Request processed in 90us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042844.917006:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789042844.917045:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a520c2d80 x1875947267568896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042860 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042844.917061:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a520c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267568896:0@lo:13: 00010000:00010000:3.0:1789042845.049733:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789042846.068772:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789042847.092375:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789042848.126807:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789042849.140458:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789042850.035338:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267569024:0@lo:13: 00000100:00100000:1.0:1789042850.035404:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042850.035690:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267569024 00000100:00100000:3.0:1789042850.035698:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267569024 00000100:00100000:3.0:1789042850.035749:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789042850.035760:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267569024:12345-0@lo:13: 00002000:00000024:3.0:1789042850.035793:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789042850.035836:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267569024:12345-0@lo:13: Request processed in 78us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042850.035842:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789042850.035863:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875947267569280:0@lo:400: 00000100:00100000:3.0:1789042850.035890:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042850.035908:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789042850.035922:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875947267569408:0@lo:400: 00000100:00100000:3.0:1789042850.035944:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789042850.035972:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789042850.035987:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267569280 00000100:00100000:3.0:1789042850.035990:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267569280 00000100:00100000:3.0:1789042850.036013:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267569408 00000100:00100000:3.0:1789042850.036015:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267569408 00000100:00100000:3.0:1789042850.036034:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789042850.036039:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875947267569280:12345-0@lo:400: 00000100:00100000:3.0:1789042850.036084:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875947267569280:12345-0@lo:400: Request processed in 45us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042850.036090:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789042850.036100:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789042850.036105:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875947267569408:12345-0@lo:400: 00000100:00100000:3.0:1789042850.036128:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875947267569408:12345-0@lo:400: Request processed in 23us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042850.036133:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1789042850.036151:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789042850.036182:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a7a024380 x1875947267569408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789042866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042850.036197:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875947267569408:0@lo:400: 00010000:00080000:3.0:1789042850.036209:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a7a027480 x1875947267569280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789042866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042850.036216:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875947267569280:0@lo:400: 00010000:00080000:3.0:1789042850.036244:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a7a8b4000 x1875947267569024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042866 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042850.036270:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267569024:0@lo:13: 00000100:00100000:3.0:1789042850.036284:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789042850.036289:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3314:1875947267569152:0@lo:400: 00000100:00100000:3.0:1789042850.036333:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042850.036365:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267569152 00000100:00100000:3.0:1789042850.036369:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267569152 00000100:00100000:3.0:1789042850.036397:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789042850.036403:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:3314:x1875947267569152:12345-0@lo:400: 00000100:00100000:3.0:1789042850.036435:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:3314:x1875947267569152:12345-0@lo:400: Request processed in 32us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042850.036440:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789042850.036473:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3314:1875947267569152:0@lo:400: 00010000:00010000:0.0:1789042850.166444:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789042851.188196:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789042851.466656:0:7630:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789042851.466661:0:7630:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789042851.467106:0:7630:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa06a7924a000 00000020:01000004:3.0:1789042851.467122:0:7630:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789042851.467136:0:7630:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789042851.467150:0:7630:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0001-osd (ffffa06a52ca0000) 00000020:00000080:3.0:1789042851.467166:0:7630:0:(obd_config.c:786:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789042851.497450:0:7630:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789042851.498121:0:7630:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1789042851.553940:0:7630:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1789042851.563511:0:7630:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789042851.564164:0:7630:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1789042851.564223:0:7630:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1789042851.564251:0:7630:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1789042851.565223:0:7630:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1789042851.565236:0:7630:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789042851.565246:0:7630:0:(genops.c:1393:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x99260d7389c05d8e 00000020:01000004:0.0:1789042851.565254:0:7630:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1789042851.565273:0:7630:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.117@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789042851.565276:0:7630:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.117@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789042851.565281:0:7630:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1789042851.565301:0:7630:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1789042851.565304:0:7630:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.117@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789042851.587259:0:7630:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.117@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789042851.587297:0:7630:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.117@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1789042851.587301:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789042851.587303:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789042851.587304:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789042851.587306:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789042851.587307:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789042851.587308:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789042851.587310:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789042851.587311:0:7630:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789042851.587313:0:7630:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789042851.587314:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789042851.587315:0:7630:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789042851.587318:0:7630:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1789042851.587387:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789042851.587390:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789042851.587391:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789042851.587392:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789042851.587393:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789042851.587400:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789042851.587401:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789042851.587402:0:7630:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789042851.587403:0:7630:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789042851.587404:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789042851.587405:0:7630:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789042851.587432:0:7630:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789042851.587449:0:7630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75edc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267569536:0@lo:253: 00000100:00100000:2.0:1789042851.587650:0:7630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042851.587752:0:7630:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a467b4240 going to sleep for 11 seconds 00000100:00100000:1.0:1789042851.587806:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267569536 00000100:00100000:1.0:1789042851.587814:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267569536 00000100:00100000:1.0:1789042851.587927:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789042851.587937:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43885850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:7630:x1875947267569536:12345-0@lo:253: 20000000:01000000:1.0:1789042851.587977:0:5839:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789042851.587987:0:5839:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1789042851.587992:0:5839:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1789042851.587996:0:5839:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1789042851.588927:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789042851.589163:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1789042851.589178:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1789042851.589219:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1789042851.589227:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1789042851.589259:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1789042851.589309:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1789042851.589684:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1789042851.589702:0:5839:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.117@tcp 20000000:01000000:1.0:1789042851.589704:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.117@tcp (null) (null) (null) 00000040:00080000:1.0:1789042851.589740:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1789042851.589749:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789042851.589798:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1789042851.589806:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.117@tcp (null) (null) 00000040:00080000:1.0:1789042851.589841:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1789042851.589850:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789042851.589882:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1789042851.589934:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1789042851.590686:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1789042851.590704:0:5839:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.117@tcp 20000000:01000000:1.0:1789042851.590706:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.117@tcp (null) (null) (null) 00000040:00080000:1.0:1789042851.590742:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1789042851.590751:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789042851.590783:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1789042851.590791:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.117@tcp (null) (null) 00000040:00080000:1.0:1789042851.590822:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1789042851.590831:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789042851.590878:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1789042851.590917:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1789042851.590938:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789042851.590942:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789042851.590946:0:5839:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789042851.590957:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789042851.590960:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789042851.590990:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789042851.590992:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789042851.597765:0:7632:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1789042851.597867:0:7632:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1789042851.597900:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1789042851.604294:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1789042851.604409:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1789042851.604466:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1789042851.604478:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789042851.604481:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789042851.616985:0:7633:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1789042851.617090:0:7633:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1789042851.617148:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1789042851.617470:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1789042851.617722:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1789042851.617767:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1789042851.617779:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789042851.617782:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789042851.618198:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1789042851.618471:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1789042851.618673:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1789042851.618949:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1789042851.618966:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789042851.618968:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789042851.619402:0:7635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1789042851.619446:0:7635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1789042851.619500:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1789042851.619889:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1789042851.619926:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1789042851.619976:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1789042851.619992:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1789042851.619994:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1789042851.620002:0:5839:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789042851.620021:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa06a58604800/0x99260d7389c05d95 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042851.620038:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a58605400/0x99260d7389c05ce6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05cdf expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042851.620066:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a40031400/0x99260d7389c05d10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05d09 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042851.620074:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a429f4a00/0x99260d7389c05d3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05d33 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042851.620080:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a40031600/0x99260d7389c05d56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05d4f expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042851.620098:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a41686200/0x99260d7389c05d80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05d79 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042851.620106:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa06a58604800/0x99260d7389c05d95 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042851.620145:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a41686200/0x99260d7389c05d80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99260d7389c05d79 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042851.620159:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa06a41686200/0x99260d7389c05d80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99260d7389c05d79 expref: 16 pid: 5840 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042851.620173:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75eddf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5839:1875947267569664:0@lo:104: 00000100:00100000:2.0:1789042851.620236:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789042851.620289:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a40031600/0x99260d7389c05d56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99260d7389c05d4f expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042851.620297:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa06a40031600/0x99260d7389c05d56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99260d7389c05d4f expref: 16 pid: 5839 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042851.620305:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75edf480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5839:1875947267569792:0@lo:104: 00010000:00010000:2.0:1789042851.620354:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a429f4a00/0x99260d7389c05d3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99260d7389c05d33 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042851.620363:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa06a429f4a00/0x99260d7389c05d3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99260d7389c05d33 expref: 16 pid: 5840 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042851.620372:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75edce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5839:1875947267569920:0@lo:104: 00010000:00010000:2.0:1789042851.620398:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a40031400/0x99260d7389c05d10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99260d7389c05d09 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042851.620412:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa06a40031400/0x99260d7389c05d10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99260d7389c05d09 expref: 16 pid: 5840 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042851.620420:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75ede300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5839:1875947267570048:0@lo:104: 00010000:00010000:2.0:1789042851.620440:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a58605400/0x99260d7389c05ce6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99260d7389c05cdf expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042851.620447:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa06a58605400/0x99260d7389c05ce6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99260d7389c05cdf expref: 16 pid: 5841 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042851.620453:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75edc700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5839:1875947267570176:0@lo:104: 00000100:00100000:2.0:1789042851.620466:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a467b4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789042851.621696:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789042851.621725:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042851.621756:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042851.621765:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042851.621774:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042851.621785:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267569664 00000100:00100000:1.0:1789042851.621792:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267569664 00000100:00100000:1.0:1789042851.621824:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267569792 00000100:00100000:1.0:1789042851.621834:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267569792 00000100:00100000:1.0:1789042851.621846:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267569920 00000100:00100000:1.0:1789042851.621848:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267569920 00000100:00100000:1.0:1789042851.621855:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267570048 00000100:00100000:1.0:1789042851.621857:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267570048 00000100:00100000:1.0:1789042851.621865:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267570176 00000100:00100000:1.0:1789042851.621867:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267570176 00000100:00100000:1.0:1789042851.621878:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789042851.621886:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a472f3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+7:5839:x1875947267569664:12345-0@lo:104: 00010000:00010000:1.0:1789042851.621902:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffffa06a429f4c00/0x99260d7389c05d79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05d80 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.621969:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789042851.621975:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a472f3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+7:5839:x1875947267569664:12345-0@lo:104: Request processed in 90us (1740us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042851.621984:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789042851.622021:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789042851.622027:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+6:5839:x1875947267569792:12345-0@lo:104: 00010000:00010000:1.0:1789042851.622035:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05d4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05d56 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.622080:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789042851.622085:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+6:5839:x1875947267569792:12345-0@lo:104: Request processed in 59us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042851.622091:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789042851.622104:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789042851.622110:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+5:5839:x1875947267569920:12345-0@lo:104: 00010000:00010000:1.0:1789042851.622117:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffffa06a58605200/0x99260d7389c05d33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05d3a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.622158:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789042851.622163:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+5:5839:x1875947267569920:12345-0@lo:104: Request processed in 54us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042851.622168:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789042851.622180:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789042851.622185:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+4:5839:x1875947267570048:12345-0@lo:104: 00010000:00010000:1.0:1789042851.622191:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffffa06a40030e00/0x99260d7389c05d09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05d10 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.622213:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789042851.622218:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+4:5839:x1875947267570048:12345-0@lo:104: Request processed in 33us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042851.622223:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789042851.622232:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789042851.622236:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+3:5839:x1875947267570176:12345-0@lo:104: 00010000:00010000:1.0:1789042851.622242:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffffa06a429f4200/0x99260d7389c05cdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05ce6 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.622262:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1789042851.622266:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+3:5839:x1875947267570176:12345-0@lo:104: Request processed in 30us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042851.622271:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1789042851.622285:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1789042851.622291:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a429f4c00/0x99260d7389c05d79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05d80 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.622297:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a429f4c00 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:1.0:1789042851.622305:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a429f4c00/0x99260d7389c05d79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x99260d7389c05d80 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.622314:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a429f4c00/0x99260d7389c05d79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x99260d7389c05d80 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042851.622425:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75eddf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5839:1875947267569664:0@lo:104: 00000100:00100000:0.0:1789042851.622435:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75edf480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5839:1875947267569792:0@lo:104: 00000100:00100000:0.0:1789042851.622441:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75edce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5839:1875947267569920:0@lo:104: 00000100:00100000:0.0:1789042851.622447:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75ede300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5839:1875947267570048:0@lo:104: 00000100:00100000:0.0:1789042851.622453:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75edc700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5839:1875947267570176:0@lo:104: 00010000:00010000:0.0:1789042851.622479:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa06a58604800/0x99260d7389c05d95 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789042851.623837:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a429f4c00/0x99260d7389c05d79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x99260d7389c05d80 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789042851.623851:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789042851.623940:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a429f4c00/0x99260d7389c05d79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05d80 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.623948:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789042851.623973:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a429f4c00/0x99260d7389c05d79 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05d80 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.623982:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a429f4c00/0x99260d7389c05d79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05d80 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.624002:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789042851.624005:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05d4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05d56 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.624012:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a40031e00 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:1.0:1789042851.624016:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05d4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x99260d7389c05d56 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.624025:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05d4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x99260d7389c05d56 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789042851.624058:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05d4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x99260d7389c05d56 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789042851.624063:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789042851.624118:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3314:1875947267570304:0@lo:103: 00000100:00100000:2.0:1789042851.624167:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042851.624223:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267570304 00000100:00100000:2.0:1789042851.624230:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267570304 00010000:00010000:2.0:1789042851.624251:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a41686200/0x99260d7389c05d80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05d79 expref: 17 pid: 5840 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042851.624276:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789042851.624284:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75edca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:3314:x1875947267570304:12345-0@lo:103: 00010000:00010000:2.0:1789042851.624294:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789042851.624298:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a41686200/0x99260d7389c05d80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05d79 expref: 17 pid: 5840 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042851.624310:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a41686200/0x99260d7389c05d80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99260d7389c05d79 expref: 17 pid: 5840 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042851.624347:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a41686200/0x99260d7389c05d80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99260d7389c05d79 expref: 17 pid: 5840 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042851.624360:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789042851.624390:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75edca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:3314:x1875947267570304:12345-0@lo:103: Request processed in 106us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042851.624397:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789042851.624431:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3314:1875947267570304:0@lo:103: 00010000:00010000:1.0:1789042851.627234:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05d4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05d56 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.627250:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789042851.627273:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05d4f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05d56 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.627281:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05d4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05d56 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.627294:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789042851.627299:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a58605200/0x99260d7389c05d33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05d3a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.627305:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a58605200 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:1.0:1789042851.627309:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a58605200/0x99260d7389c05d33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x99260d7389c05d3a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.627317:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a58605200/0x99260d7389c05d33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x99260d7389c05d3a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789042851.627335:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a58605200/0x99260d7389c05d33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x99260d7389c05d3a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789042851.627341:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789042851.627387:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789042851.627406:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3314:1875947267570432:0@lo:103: 00000100:00100000:2.0:1789042851.627463:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042851.629449:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267570432 00000100:00100000:3.0:1789042851.629460:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267570432 00010000:00010000:3.0:1789042851.629495:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a40031600/0x99260d7389c05d56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05d4f expref: 16 pid: 5839 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042851.629559:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789042851.629579:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75eded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:3314:x1875947267570432:12345-0@lo:103: 00010000:00010000:3.0:1789042851.629592:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789042851.629598:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a40031600/0x99260d7389c05d56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05d4f expref: 16 pid: 5839 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042851.629610:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a40031600/0x99260d7389c05d56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99260d7389c05d4f expref: 16 pid: 5839 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042851.629627:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a40031600/0x99260d7389c05d56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99260d7389c05d4f expref: 16 pid: 5839 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042851.629642:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789042851.629696:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75eded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:3314:x1875947267570432:12345-0@lo:103: Request processed in 118us (2232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042851.629703:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789042851.630660:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3314:1875947267570432:0@lo:103: 00010000:00010000:1.0:1789042851.631738:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a58605200/0x99260d7389c05d33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05d3a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.631748:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789042851.631793:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267570560:0@lo:103: 00000100:00100000:3.0:1789042851.631844:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789042851.632105:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a58605200/0x99260d7389c05d33 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05d3a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.632115:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a58605200/0x99260d7389c05d33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05d3a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.632130:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789042851.632135:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a40030e00/0x99260d7389c05d09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05d10 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.632142:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a40030e00 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:1.0:1789042851.632146:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a40030e00/0x99260d7389c05d09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x99260d7389c05d10 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.632155:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a40030e00/0x99260d7389c05d09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x99260d7389c05d10 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789042851.632162:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a40030e00/0x99260d7389c05d09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x99260d7389c05d10 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789042851.632167:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789042851.632188:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a40030e00/0x99260d7389c05d09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05d10 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.632194:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789042851.632229:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267570688:0@lo:103: 00000100:00100000:0.0:1789042851.632260:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789042851.636798:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a40030e00/0x99260d7389c05d09 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05d10 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.636834:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a40030e00/0x99260d7389c05d09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05d10 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.636853:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789042851.636857:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a429f4200/0x99260d7389c05cdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05ce6 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.636864:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a429f4200 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:1.0:1789042851.636868:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a429f4200/0x99260d7389c05cdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x99260d7389c05ce6 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.636877:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a429f4200/0x99260d7389c05cdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x99260d7389c05ce6 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789042851.636884:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a429f4200/0x99260d7389c05cdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x99260d7389c05ce6 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789042851.636890:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789042851.636926:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a429f4200/0x99260d7389c05cdf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05ce6 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.636933:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789042851.636949:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a429f4200/0x99260d7389c05cdf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05ce6 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.636956:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a429f4200/0x99260d7389c05cdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05ce6 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.636975:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789042851.636982:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789042851.636984:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789042851.636991:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789042851.636998:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789042851.637013:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3315:1875947267570816:0@lo:103: 00000100:00100000:1.0:1789042851.637078:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042851.637179:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267570560 00000100:00100000:2.0:1789042851.637187:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267570560 00010000:00010000:2.0:1789042851.637215:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a429f4a00/0x99260d7389c05d3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05d33 expref: 15 pid: 5840 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042851.641436:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267570688 00000100:00100000:2.0:1789042851.641450:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267570688 00010000:00010000:2.0:1789042851.641493:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a40031400/0x99260d7389c05d10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05d09 expref: 16 pid: 5840 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042851.644141:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267570816 00000100:00100000:3.0:1789042851.644155:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267570816 00010000:00010000:3.0:1789042851.644195:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a58605400/0x99260d7389c05ce6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05cdf expref: 17 pid: 5841 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042851.644229:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789042851.644238:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a024700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:3312:x1875947267570560:12345-0@lo:103: 00010000:00010000:3.0:1789042851.644252:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789042851.644258:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a429f4a00/0x99260d7389c05d3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05d33 expref: 17 pid: 5840 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042851.644270:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a429f4a00/0x99260d7389c05d3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99260d7389c05d33 expref: 17 pid: 5840 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042851.644304:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a429f4a00/0x99260d7389c05d3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99260d7389c05d33 expref: 17 pid: 5840 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042851.644330:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789042851.644407:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a024700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:3312:x1875947267570560:12345-0@lo:103: Request processed in 170us (12562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042851.644415:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789042851.644436:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789042851.644443:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a520c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:3313:x1875947267570688:12345-0@lo:103: 00010000:00010000:3.0:1789042851.644452:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789042851.644457:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a40031400/0x99260d7389c05d10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05d09 expref: 15 pid: 5840 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042851.644466:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a40031400/0x99260d7389c05d10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99260d7389c05d09 expref: 15 pid: 5840 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042851.644477:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a40031400/0x99260d7389c05d10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99260d7389c05d09 expref: 15 pid: 5840 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042851.644487:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789042851.645252:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267570560:0@lo:103: 00000100:00100000:3.0:1789042851.645331:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a520c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+14:3313:x1875947267570688:12345-0@lo:103: Request processed in 878us (13060us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042851.645339:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789042851.645360:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789042851.645370:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:3315:x1875947267570816:12345-0@lo:103: 00010000:00010000:3.0:1789042851.645381:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789042851.645388:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a58605400/0x99260d7389c05ce6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05cdf expref: 13 pid: 5841 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042851.645407:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a58605400/0x99260d7389c05ce6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99260d7389c05cdf expref: 13 pid: 5841 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042851.645420:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a58605400/0x99260d7389c05ce6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99260d7389c05cdf expref: 13 pid: 5841 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042851.645433:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa06a58604800/0x99260d7389c05d95 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042851.645442:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a58604800/0x99260d7389c05d95 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042851.645459:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa06a58604800/0x99260d7389c05d95 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042851.645467:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa06a58604800/0x99260d7389c05d95 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042851.645474:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa06a58604800/0x99260d7389c05d95 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042851.645482:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa06a58604800/0x99260d7389c05d95 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042851.645489:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a58604800 already unused, calling callback (ffffffffc1470760) 00010000:00010000:3.0:1789042851.645493:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa06a58604800/0x99260d7389c05d95 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042851.645502:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa06a58604800/0x99260d7389c05d95 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042851.645705:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa06a58604800/0x99260d7389c05d95 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042851.645716:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789042851.645757:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:3315:x1875947267570816:12345-0@lo:103: Request processed in 390us (8678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042851.645764:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789042851.645861:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267570688:0@lo:103: 00000100:00100000:1.0:1789042851.645925:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3315:1875947267570816:0@lo:103: 00010000:00010000:1.0:1789042851.645945:0:5839:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa06a58604800/0x99260d7389c05d95 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.645953:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa06a58604800/0x99260d7389c05d95 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.645959:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a58604800/0x99260d7389c05d95 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789042851.645973:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789042851.694988:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43885850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+11:7630:x1875947267569536:12345-0@lo:253: Request processed in 107046us (107467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042851.695002:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789042851.695136:0:7630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75edc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267569536:0@lo:253: 10000000:01000000:2.0:1789042851.695151:0:7630:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789042851.695154:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789042851.695156:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789042851.695157:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789042851.695158:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1789042851.695171:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789042851.695172:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789042851.695173:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789042851.695175:0:7630:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789042851.695177:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789042851.695178:0:7630:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789042851.695194:0:7630:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa06a7924a000 from lustre-OST0001 10000000:01000000:2.0:1789042851.695216:0:7630:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789042851.695218:0:7630:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789042851.695225:0:7630:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa06a5209cd88 local copy 10000000:01000000:2.0:1789042851.695229:0:7630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789042851.695262:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a58604600/0x99260d7389c05d9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042851.695272:0:7630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.117@tcp lock: ffffa06a58604600/0x99260d7389c05d9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042851.695281:0:7630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a58604600/0x99260d7389c05d9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042851.695297:0:7630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75edc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267570944:0@lo:101: 00000100:00100000:2.0:1789042851.695394:0:7630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042851.695462:0:7630:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a467b4600 going to sleep for 11 seconds 00000100:00100000:3.0:1789042851.695501:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267570944 00000100:00100000:3.0:1789042851.695507:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267570944 00000100:00100000:3.0:1789042851.695656:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789042851.695665:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+11:7630:x1875947267570944:12345-0@lo:101: 00010000:00010000:3.0:1789042851.695677:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789042851.695690:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a6fc29000/0x99260d7389c05da3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05d9c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042851.695715:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a6fc29000/0x99260d7389c05da3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05d9c expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042851.695725:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a6fc29000/0x99260d7389c05da3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05d9c expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042851.695733:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc29000, rc 0) 00000100:00100000:3.0:1789042851.695811:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:7630:x1875947267570944:12345-0@lo:101: Request processed in 147us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042851.695817:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789042851.695894:0:7630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75edc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267570944:0@lo:101: 00010000:00010000:2.0:1789042851.695906:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a58604600/0x99260d7389c05d9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x99260d7389c05da3 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042851.695915:0:7630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a58604600/0x99260d7389c05d9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x99260d7389c05da3 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042851.696002:0:7630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75edc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267571072:0@lo:501: 00000100:00100000:2.0:1789042851.696027:0:7630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042851.696154:0:7630:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a467b4600 going to sleep for 11 seconds 00000100:00100000:3.0:1789042851.696190:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267571072 00000100:00100000:3.0:1789042851.696200:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267571072 00000100:00100000:3.0:1789042851.696232:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789042851.696238:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43885c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:7630:x1875947267571072:12345-0@lo:501: 00000100:00100000:3.0:1789042851.696642:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43885c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:7630:x1875947267571072:12345-0@lo:501: Request processed in 402us (613us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789042851.696649:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789042851.696738:0:7630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75edc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267571072:0@lo:501: 10000000:01000000:2.0:1789042851.696750:0:7630:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.117@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789042851.696774:0:7630:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.117@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789042851.696780:0:7630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a58604600/0x99260d7389c05d9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x99260d7389c05da3 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042851.696788:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a58604600/0x99260d7389c05d9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x99260d7389c05da3 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042851.696796:0:7630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffffa06a58604600/0x99260d7389c05d9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x99260d7389c05da3 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042851.696849:0:7630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789042851.696866:0:7630:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa06a7924a000 10000000:01000000:2.0:1789042851.696871:0:7630:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789042851.696875:0:7630:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789042851.696878:0:7630:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789042851.696882:0:7630:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789042851.696884:0:7630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789042851.696900:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c05daa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042851.696908:0:7630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c05daa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042851.696916:0:7630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c05daa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042851.696929:0:7630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75edc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267571200:0@lo:101: 00000100:00100000:2.0:1789042851.696961:0:7630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042851.696986:0:7630:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a467b4900 going to sleep for 11 seconds 00000100:00100000:0.0:1789042851.697037:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267571200 00000100:00100000:0.0:1789042851.697042:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267571200 00000100:00100000:0.0:1789042851.697142:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789042851.697150:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43885050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:7630:x1875947267571200:12345-0@lo:101: 00010000:00010000:0.0:1789042851.697158:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789042851.697169:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a40030600/0x99260d7389c05db1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05daa expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042851.697186:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a40030600/0x99260d7389c05db1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05daa expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042851.697194:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a40030600/0x99260d7389c05db1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05daa expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042851.697212:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a40030600, rc 0) 00000100:00100000:0.0:1789042851.697251:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43885050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:7630:x1875947267571200:12345-0@lo:101: Request processed in 102us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042851.697257:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789042851.697430:0:7630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75edc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267571200:0@lo:101: 00010000:00010000:2.0:1789042851.697441:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c05daa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05db1 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042851.697450:0:7630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c05daa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05db1 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042851.697508:0:7630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75edc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267571328:0@lo:501: 00000100:00100000:2.0:1789042851.697584:0:7630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042851.697602:0:7630:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a467b4900 going to sleep for 11 seconds 00000100:00100000:0.0:1789042851.697711:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267571328 00000100:00100000:0.0:1789042851.697716:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267571328 00000100:00100000:0.0:1789042851.697748:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789042851.697755:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:7630:x1875947267571328:12345-0@lo:501: 00000100:00100000:0.0:1789042851.697937:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:7630:x1875947267571328:12345-0@lo:501: Request processed in 182us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042851.697943:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789042851.698129:0:7630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75edc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267571328:0@lo:501: 00000100:00100000:3.0:1789042851.698158:0:7630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a027480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267571456:0@lo:503: 00000100:00100000:3.0:1789042851.698197:0:7630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042851.698222:0:7630:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a52c309c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789042851.698275:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267571456 00000100:00100000:0.0:1789042851.698280:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267571456 00000100:00100000:0.0:1789042851.698307:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789042851.698314:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:7630:x1875947267571456:12345-0@lo:503: 00000100:00100000:0.0:1789042851.698648:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:7630:x1875947267571456:12345-0@lo:503: Request processed in 333us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042851.698655:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789042851.698782:0:7630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a027480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267571456:0@lo:503: 00010000:00010000:1.0:1789042851.699160:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789042851.699168:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a58604600/0x99260d7389c05d9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x99260d7389c05da3 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.699177:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a58604600 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:1.0:1789042851.699181:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a58604600/0x99260d7389c05d9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x99260d7389c05da3 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.699190:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a58604600/0x99260d7389c05d9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x99260d7389c05da3 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789042851.699198:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a58604600/0x99260d7389c05d9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x99260d7389c05da3 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789042851.699211:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000040:00080000:3.0:1789042851.699319:0:7630:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789042851.699443:0:7630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a027480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267571584:0@lo:502: 00000100:00100000:3.0:1789042851.699481:0:7630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789042851.699698:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a58604600/0x99260d7389c05d9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x99260d7389c05da3 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042851.699706:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789042851.699732:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a58604600/0x99260d7389c05d9c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x99260d7389c05da3 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042851.699739:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a58604600/0x99260d7389c05d9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x99260d7389c05da3 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042851.699751:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789042851.699752:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789042851.699754:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789042851.699791:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75ede680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3315:1875947267571712:0@lo:103: 00000100:00100000:1.0:1789042851.699821:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042851.699947:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267571712 00000100:00100000:2.0:1789042851.699952:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267571712 00000100:00100000:2.0:1789042851.699995:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789042851.700004:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:3315:x1875947267571712:12345-0@lo:103: 00010000:00010000:2.0:1789042851.700024:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789042851.700037:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a6fc29000/0x99260d7389c05da3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x99260d7389c05d9c expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042851.700150:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789042851.700188:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:3315:x1875947267571712:12345-0@lo:103: Request processed in 185us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042851.700195:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789042851.700250:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75ede680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3315:1875947267571712:0@lo:103: 00000100:00100000:3.0:1789042851.700388:0:7630:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a52c309c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789042851.700430:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267571584 00000100:00100000:2.0:1789042851.700434:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267571584 00000100:00100000:2.0:1789042851.700492:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789042851.700500:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:7630:x1875947267571584:12345-0@lo:502: 00000100:00100000:2.0:1789042851.700887:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:7630:x1875947267571584:12345-0@lo:502: Request processed in 386us (1404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042851.700894:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789042851.700950:0:7630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a027480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267571584:0@lo:502: 00000040:00080000:1.0:1789042851.703628:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789042851.703718:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789042851.703758:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789042851.703811:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789042851.703849:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789042851.703887:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789042851.703934:0:7630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267571840:0@lo:502: 00000100:00100000:1.0:1789042851.704005:0:7630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042851.704173:0:7630:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a76602300 going to sleep for 11 seconds 00000100:00100000:3.0:1789042851.704243:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267571840 00000100:00100000:3.0:1789042851.704252:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267571840 00000100:00100000:3.0:1789042851.704303:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789042851.704312:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:7630:x1875947267571840:12345-0@lo:502: 00000100:00100000:3.0:1789042851.704497:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:7630:x1875947267571840:12345-0@lo:502: Request processed in 185us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042851.704505:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789042851.704730:0:7630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267571840:0@lo:502: 00000040:00080000:1.0:1789042851.704823:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789042851.704835:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1789042851.705489:0:7638:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789042851.705497:0:7638:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1789042851.705504:0:7638:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789042851.705506:0:7638:0:(obd_config.c:1661:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789042851.705541:0:7638:0:(obd_config.c:1570:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789042851.705557:0:7638:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0001 (ffffa06a7732b3b0) 00000020:00000080:1.0:1789042851.705577:0:7638:0:(obd_config.c:786:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789042851.705583:0:7638:0:(obd_config.c:1570:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789042851.705639:0:7638:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa06a7924a000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789042851.705645:0:7638:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789042851.705659:0:7638:0:(genops.c:1393:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x99260d7389c05dbf 00010000:00010000:2.0:1789042851.709998:0:7638:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1789042851.710479:0:7638:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1789042851.713225:0:7638:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789042851.713477:0:7638:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1789042851.718000:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1789042851.718753:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1789042851.720232:0:7638:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789042851.720242:0:7638:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789042851.720249:0:7638:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789042851.720251:0:7638:0:(obd_config.c:1661:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789042851.720254:0:7638:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789042851.720258:0:7638:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789042851.720259:0:7638:0:(obd_config.c:1661:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789042851.720262:0:7638:0:(obd_config.c:1570:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789042851.720269:0:7638:0:(obd_config.c:1635:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789042851.720312:0:7638:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789042851.720314:0:7638:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789042851.720316:0:7638:0:(obd_config.c:1661:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789042851.720319:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789042851.721137:0:7630:0:(obd_config.c:2243:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1789042851.721163:0:7630:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789042851.721185:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c05daa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05db1 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042851.721208:0:7630:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c05daa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05db1 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789042851.721216:0:7630:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa06a7924a000 from 1 10000000:01000000:3.0:1789042851.721219:0:7630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789042851.721249:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28400/0x99260d7389c05dc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042851.721256:0:7630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28400/0x99260d7389c05dc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042851.721267:0:7630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28400/0x99260d7389c05dc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042851.721287:0:7630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a024380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267571968:0@lo:101: 00000100:00100000:3.0:1789042851.721412:0:7630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042851.721444:0:7630:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a52c30600 going to sleep for 11 seconds 00000100:00100000:2.0:1789042851.721627:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267571968 00000100:00100000:2.0:1789042851.721634:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267571968 00000100:00100000:2.0:1789042851.721667:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789042851.721675:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:7630:x1875947267571968:12345-0@lo:101: 00010000:00010000:2.0:1789042851.721687:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789042851.721699:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a58604600/0x99260d7389c05dcd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05dc6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042851.721720:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a58604600/0x99260d7389c05dcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05dc6 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042851.721730:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a58604600/0x99260d7389c05dcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05dc6 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042851.721738:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a58604600, rc 0) 00000100:00100000:2.0:1789042851.721770:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:7630:x1875947267571968:12345-0@lo:101: Request processed in 96us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042851.721777:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789042851.722386:0:7630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a024380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267571968:0@lo:101: 00010000:00010000:3.0:1789042851.722400:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28400/0x99260d7389c05dc6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05dcd expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042851.722408:0:7630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28400/0x99260d7389c05dc6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05dcd expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042851.722503:0:7630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a024380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267572096:0@lo:501: 00000100:00100000:3.0:1789042851.722614:0:7630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042851.722636:0:7630:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a52c30600 going to sleep for 11 seconds 00000100:00100000:3.0:1789042851.722653:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267572096 00000100:00100000:3.0:1789042851.722657:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267572096 00000100:00100000:3.0:1789042851.722681:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789042851.722688:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:7630:x1875947267572096:12345-0@lo:501: 00000100:00100000:3.0:1789042851.722867:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:7630:x1875947267572096:12345-0@lo:501: Request processed in 178us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042851.722873:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789042851.722906:0:7630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a024380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267572096:0@lo:501: 00000100:00100000:3.0:1789042851.722926:0:7630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a024380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267572224:0@lo:503: 00000100:00100000:3.0:1789042851.722956:0:7630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042851.722967:0:7630:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a52c30600 going to sleep for 11 seconds 00000100:00100000:3.0:1789042851.722979:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267572224 00000100:00100000:3.0:1789042851.722982:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267572224 00000100:00100000:3.0:1789042851.722999:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789042851.723005:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:7630:x1875947267572224:12345-0@lo:503: 00000100:00100000:3.0:1789042851.723955:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:7630:x1875947267572224:12345-0@lo:503: Request processed in 947us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042851.723963:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789042851.724004:0:7630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a024380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267572224:0@lo:503: 00000040:00080000:3.0:1789042851.724413:0:7630:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789042851.724474:0:7630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a024380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267572352:0@lo:502: 00000100:00100000:3.0:1789042851.724851:0:7630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042851.724888:0:7630:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a52c30600 going to sleep for 11 seconds 00000100:00100000:1.0:1789042851.724961:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267572352 00000100:00100000:1.0:1789042851.724968:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267572352 00000100:00100000:1.0:1789042851.725003:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789042851.725010:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:7630:x1875947267572352:12345-0@lo:502: 00000100:00100000:1.0:1789042851.725188:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:7630:x1875947267572352:12345-0@lo:502: Request processed in 178us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042851.725195:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789042851.725385:0:7630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a024380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267572352:0@lo:502: 00000040:00080000:3.0:1789042851.725762:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789042851.725808:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789042851.725839:0:7630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a024380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267572480:0@lo:502: 00000100:00100000:3.0:1789042851.725875:0:7630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042851.725902:0:7630:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a52c30600 going to sleep for 11 seconds 00000100:00100000:1.0:1789042851.726135:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267572480 00000100:00100000:1.0:1789042851.726141:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267572480 00000100:00100000:1.0:1789042851.726174:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789042851.726181:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:7630:x1875947267572480:12345-0@lo:502: 00000100:00100000:1.0:1789042851.726424:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:7630:x1875947267572480:12345-0@lo:502: Request processed in 141us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042851.726432:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789042851.726555:0:7630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a024380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267572480:0@lo:502: 00000040:00080000:3.0:1789042851.726638:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789042851.726648:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789042851.730869:0:7641:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789042851.730881:0:7641:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789042851.730884:0:7641:0:(obd_config.c:1661:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789042851.730890:0:7641:0:(obd_config.c:2102:class_config_llog_handler()) cmd ce032, instance name: general-ffffa06a7924a000 00000020:00000080:3.0:1789042851.730892:0:7641:0:(obd_config.c:1570:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789042851.730908:0:7641:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789042851.730910:0:7641:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789042851.730912:0:7641:0:(obd_config.c:1661:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789042851.730915:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789042851.731038:0:7630:0:(obd_config.c:2243:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789042851.731119:0:7630:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789042851.731144:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28400/0x99260d7389c05dc6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05dcd expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.731158:0:7630:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28400/0x99260d7389c05dc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05dcd expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789042851.731202:0:7630:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789042851.731205:0:7630:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa06a7924a000 10000000:01000000:1.0:1789042851.731208:0:7630:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa06a7924a000 10000000:01000000:1.0:1789042851.731211:0:7630:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789042851.731216:0:7630:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa06a7924a000 from 1 10000000:01000000:1.0:1789042851.731218:0:7630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789042851.731258:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41686600/0x99260d7389c05dd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.731267:0:7630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a41686600/0x99260d7389c05dd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.731287:0:7630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a41686600/0x99260d7389c05dd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042851.731307:0:7630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267572608:0@lo:101: 00000100:00100000:1.0:1789042851.731369:0:7630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042851.731400:0:7630:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a76602900 going to sleep for 11 seconds 00000100:00100000:1.0:1789042851.731420:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267572608 00000100:00100000:1.0:1789042851.731427:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267572608 00000100:00100000:1.0:1789042851.731470:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789042851.731477:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:7630:x1875947267572608:12345-0@lo:101: 00010000:00010000:1.0:1789042851.731489:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789042851.731499:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a41687c00/0x99260d7389c05ddb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05dd4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.731741:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a41687c00/0x99260d7389c05ddb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05dd4 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.731754:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a41687c00/0x99260d7389c05ddb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05dd4 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042851.731762:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41687c00, rc 0) 00000100:00100000:1.0:1789042851.731793:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+14:7630:x1875947267572608:12345-0@lo:101: Request processed in 317us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042851.731799:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789042851.731875:0:7630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267572608:0@lo:101: 00010000:00010000:0.0:1789042851.731889:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a41686600/0x99260d7389c05dd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05ddb expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042851.731897:0:7630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a41686600/0x99260d7389c05dd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05ddb expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042851.731977:0:7630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a520c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267572736:0@lo:501: 00000100:00100000:0.0:1789042851.732009:0:7630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042851.732035:0:7630:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a50a62d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789042851.732132:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267572736 00000100:00100000:1.0:1789042851.732136:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267572736 00000100:00100000:1.0:1789042851.732163:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789042851.732169:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+14:7630:x1875947267572736:12345-0@lo:501: 00000100:00100000:1.0:1789042851.732493:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+14:7630:x1875947267572736:12345-0@lo:501: Request processed in 323us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042851.732500:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789042851.732628:0:7630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a520c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267572736:0@lo:501: 00000100:00100000:0.0:1789042851.732653:0:7630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a520c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267572864:0@lo:503: 00000100:00100000:0.0:1789042851.732685:0:7630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042851.732708:0:7630:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a50a62d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789042851.732843:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267572864 00000100:00100000:1.0:1789042851.732847:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267572864 00000100:00100000:1.0:1789042851.732872:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789042851.732877:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+14:7630:x1875947267572864:12345-0@lo:503: 00000100:00100000:1.0:1789042851.733005:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+14:7630:x1875947267572864:12345-0@lo:503: Request processed in 126us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042851.733011:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789042851.733106:0:7630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a520c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267572864:0@lo:503: 00000040:00080000:3.0:1789042851.733371:0:7630:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789042851.733422:0:7630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a024380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267572992:0@lo:502: 00000100:00100000:3.0:1789042851.733458:0:7630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042851.733480:0:7630:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a52c300c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789042851.733770:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267572992 00000100:00100000:0.0:1789042851.733775:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267572992 00000100:00100000:0.0:1789042851.733804:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789042851.733810:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+14:7630:x1875947267572992:12345-0@lo:502: 00000100:00100000:0.0:1789042851.733954:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+14:7630:x1875947267572992:12345-0@lo:502: Request processed in 143us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042851.733961:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789042851.734160:0:7630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a024380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267572992:0@lo:502: 00000040:00080000:3.0:1789042851.734498:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789042851.734638:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789042851.734672:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789042851.734718:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789042851.734765:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789042851.734812:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789042851.734845:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789042851.734876:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789042851.734932:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789042851.734969:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789042851.735002:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789042851.735114:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789042851.735157:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789042851.735190:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789042851.735234:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789042851.735268:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789042851.735639:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789042851.735684:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789042851.735717:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789042851.735749:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789042851.735814:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789042851.735851:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789042851.735883:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789042851.735928:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789042851.735964:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1789042851.735998:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1789042851.736159:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1789042851.736205:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1789042851.736238:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1789042851.736296:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1789042851.736454:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1789042851.736495:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1789042851.736739:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1789042851.736794:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1789042851.736829:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1789042851.736889:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1789042851.736934:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1789042851.736974:0:7630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a024380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267573120:0@lo:502: 00000100:00100000:3.0:1789042851.737040:0:7630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042851.737238:0:7630:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a52c300c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789042851.738245:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267573120 00000100:00100000:0.0:1789042851.738254:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267573120 00000100:00100000:0.0:1789042851.738436:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789042851.738449:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+14:7630:x1875947267573120:12345-0@lo:502: 00000100:00100000:0.0:1789042851.738884:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+14:7630:x1875947267573120:12345-0@lo:502: Request processed in 436us (1843us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042851.738892:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789042851.741463:0:7630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a024380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267573120:0@lo:502: 00000040:00080000:3.0:1789042851.741777:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1789042851.741791:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1789042851.742439:0:7643:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789042851.742467:0:7643:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffffa06a76560000) 00000020:00000080:3.0:1789042851.742489:0:7643:0:(obd_config.c:786:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1789042851.742700:0:7643:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa06a7924a000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789042851.742705:0:7643:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa06a7924a000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789042851.742708:0:7643:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa06a7924a000 3 00010000:00080000:3.0:1789042851.742736:0:7643:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa06a7656e800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.117@tcp at head 00010000:00010000:3.0:1789042851.744957:0:7643:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1789042851.745410:0:7643:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789042851.745447:0:7643:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789042851.745460:0:7643:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x99260d7389c05de9 00000100:00080000:3.0:1789042851.745471:0:7643:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789042851.745477:0:7643:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa06a7656e800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:3.0:1789042851.745613:0:7643:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa06a7a024380 x1875947267573248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789042851.745667:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875947267573248:0@lo:38: 00000100:00100000:2.0:1789042851.745735:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042851.745822:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267573248 00000100:00100000:1.0:1789042851.745830:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267573248 00000100:00100000:1.0:1789042851.745864:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789042851.745872:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75edea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3311:x1875947267573248:12345-0@lo:38: 00010000:00080000:1.0:1789042851.745894:0:5847:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:1.0:1789042851.745924:0:5847:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x99260d7389c05df0 00000004:00100000:1.0:1789042851.745937:0:5847:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789042851.745964:0:5847:0:(import.c:65:import_set_state_nolock()) ffffa06a45306000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1789042851.746018:0:7643:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789042851.746104:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875947267573504:0@lo:400: 00000100:00100000:3.0:1789042851.746131:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042851.746153:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789042851.746158:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875947267573376:0@lo:400: 00000100:00100000:3.0:1789042851.746177:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042851.746201:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267573632:0@lo:400: 00000100:00100000:3.0:1789042851.746226:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042851.746255:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267573504 00000100:00100000:3.0:1789042851.746268:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267573504 00000100:00100000:3.0:1789042851.746291:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267573376 00000100:00100000:3.0:1789042851.746294:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267573376 00000100:00100000:3.0:1789042851.746307:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789042851.746313:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875947267573504:12345-0@lo:400: 00000100:00100000:3.0:1789042851.746365:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875947267573504:12345-0@lo:400: Request processed in 52us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042851.746372:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789042851.746389:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789042851.746395:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875947267573376:12345-0@lo:400: 00000100:00100000:3.0:1789042851.746436:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875947267573376:12345-0@lo:400: Request processed in 41us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042851.746442:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789042851.746481:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a7a026d80 x1875947267573376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789042867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042851.746494:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875947267573376:0@lo:400: 00010000:00080000:3.0:1789042851.746505:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a7a025180 x1875947267573504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789042867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042851.746780:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875947267573504:0@lo:400: 00000100:00100000:1.0:1789042851.751760:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75edea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875947267573248:12345-0@lo:38: Request processed in 5878us (6015us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042851.751775:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789042851.751812:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267573632 00000100:00100000:1.0:1789042851.751820:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267573632 00000100:00100000:1.0:1789042851.751860:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789042851.751876:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267573632:12345-0@lo:400: 00000100:00100000:1.0:1789042851.751948:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267573632:12345-0@lo:400: Request processed in 73us (5721us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042851.751955:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789042851.751994:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a7a027b80 x1875947267573632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789042851.752011:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267573632:0@lo:400: 00000100:00080000:1.0:1789042851.752462:0:7644:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffffa06a7a8b4700 x1875947267573760/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789042851.752472:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a76602240 going to sleep for 0 seconds 00000040:00080000:3.0:1789042851.752748:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00010000:00080000:2.0:1789042851.754803:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a7a024380 x1875947267573248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789042861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042851.754820:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789042851.754829:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1789042851.754845:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789042851.754851:0:3311:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789042851.754854:0:3311:0:(import.c:65:import_set_state_nolock()) ffffa06a7656e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1789042851.754861:0:3311:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000af5ab70a): req@ffffa06a7a8b4700 x1875947267573760/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042851.754883:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875947267573248:0@lo:38: 00000100:00100000:1.0:1789042851.755016:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042851.755738:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a76602240 going to sleep for 11 seconds 00000100:00100000:2.0:1789042851.755823:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267573760 00000100:00100000:2.0:1789042851.755831:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267573760 00000100:00100000:2.0:1789042851.755901:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789042851.755911:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7644:x1875947267573760:12345-0@lo:901: 00000100:00100000:2.0:1789042851.756503:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7644:x1875947267573760:12345-0@lo:901: Request processed in 591us (1485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042851.756602:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789042851.756668:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789042851.756748:0:7644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a7a8b4700 x1875947267573760/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789042867 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789042851.756761:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b4700 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7644:1875947267573760:0@lo:901: 00000020:01000000:0.0:1789042851.757160:0:7630:0:(obd_config.c:2243:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1789042851.757192:0:7630:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789042851.757249:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41686600/0x99260d7389c05dd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05ddb expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042851.757263:0:7630:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a41686600/0x99260d7389c05dd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05ddb expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789042851.757428:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789042851.757431:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789042851.757432:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789042851.757433:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789042851.757434:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789042851.757436:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789042851.757437:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789042851.757439:0:7630:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789042851.757440:0:7630:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789042851.757441:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789042851.757442:0:7630:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789042851.757446:0:7630:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1789042851.757448:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789042851.757450:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789042851.757451:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789042851.757452:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789042851.757453:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789042851.757454:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789042851.757455:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789042851.757456:0:7630:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789042851.757457:0:7630:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789042851.757458:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789042851.757459:0:7630:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789042851.757480:0:7630:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789042851.757495:0:7630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a520c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267573888:0@lo:253: 00000100:00100000:0.0:1789042851.757622:0:7630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042851.757652:0:7630:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a50a629c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789042851.757772:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267573888 00000100:00100000:1.0:1789042851.757779:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267573888 00000100:00100000:1.0:1789042851.757821:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789042851.757829:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+14:7630:x1875947267573888:12345-0@lo:253: 20000000:01000000:1.0:1789042851.757850:0:5840:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789042851.757863:0:5840:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789042851.829454:0:5840:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789042851.829466:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789042851.829496:0:5861:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789042851.829500:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789042851.829545:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa06a40031400/0x99260d7389c05df7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042851.829563:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a40031c00/0x99260d7389c05d48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05d41 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042851.829584:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa06a40031400/0x99260d7389c05df7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042851.829620:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a40031c00/0x99260d7389c05d48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99260d7389c05d41 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042851.829634:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa06a40031c00/0x99260d7389c05d48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99260d7389c05d41 expref: 14 pid: 5840 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042851.829649:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a520c1c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1875947267574016:0@lo:104: 00000100:00100000:0.0:1789042851.829708:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042851.829746:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a50a62540 going to sleep for 11 seconds 00000100:00100000:0.0:1789042851.829763:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267574016 00000100:00100000:0.0:1789042851.829771:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267574016 00000100:00100000:0.0:1789042851.829815:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789042851.829824:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a520c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+3:5861:x1875947267574016:12345-0@lo:104: 00010000:00010000:0.0:1789042851.829837:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffffa06a429f5600/0x99260d7389c05d41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05d48 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042851.829885:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789042851.829891:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a520c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+3:5861:x1875947267574016:12345-0@lo:104: Request processed in 68us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042851.829898:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1789042851.829919:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789042851.829925:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a429f5600/0x99260d7389c05d41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05d48 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042851.829932:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a429f5600 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:0.0:1789042851.829942:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a429f5600/0x99260d7389c05d41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x99260d7389c05d48 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042851.829950:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a429f5600/0x99260d7389c05d41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x99260d7389c05d48 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789042851.829957:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a429f5600/0x99260d7389c05d41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x99260d7389c05d48 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789042851.829962:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789042851.830003:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a429f5600/0x99260d7389c05d41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05d48 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042851.830011:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789042851.830027:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a429f5600/0x99260d7389c05d41 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05d48 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042851.830034:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a429f5600/0x99260d7389c05d41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05d48 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042851.830062:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789042851.830064:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789042851.830066:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789042851.830077:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3315:1875947267574144:0@lo:103: 00000100:00100000:0.0:1789042851.830107:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042851.830149:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267574144 00000100:00100000:0.0:1789042851.830153:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267574144 00010000:00010000:0.0:1789042851.830169:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a40031c00/0x99260d7389c05d48 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05d41 expref: 15 pid: 5840 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042851.830189:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789042851.830201:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a55f65050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:3315:x1875947267574144:12345-0@lo:103: 00010000:00010000:0.0:1789042851.830210:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789042851.830216:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a40031c00/0x99260d7389c05d48 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05d41 expref: 15 pid: 5840 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042851.830225:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a40031c00/0x99260d7389c05d48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99260d7389c05d41 expref: 15 pid: 5840 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042851.830242:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa06a40031400/0x99260d7389c05df7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042851.830250:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a40031400/0x99260d7389c05df7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789042851.830262:0:5831:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003035399s 00010000:00010000:0.0:1789042851.830267:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa06a40031400/0x99260d7389c05df7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042851.830274:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa06a40031400/0x99260d7389c05df7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042851.830281:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa06a40031400/0x99260d7389c05df7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042851.830287:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa06a40031400/0x99260d7389c05df7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042851.830292:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a40031400 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789042851.830295:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa06a40031400/0x99260d7389c05df7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042851.830302:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa06a40031400/0x99260d7389c05df7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042851.830317:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa06a40031400/0x99260d7389c05df7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042851.830327:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789042851.830355:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a55f65050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:3315:x1875947267574144:12345-0@lo:103: Request processed in 155us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042851.830362:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789042851.830419:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3315:1875947267574144:0@lo:103: 00010000:00010000:0.0:1789042851.830442:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a40031c00/0x99260d7389c05d48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99260d7389c05d41 expref: 14 pid: 5840 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042851.830453:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a520c1c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1875947267574016:0@lo:104: 00010000:00010000:0.0:1789042851.830462:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa06a40031400/0x99260d7389c05df7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042851.830470:0:5861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa06a40031400/0x99260d7389c05df7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042851.830475:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa06a40031400/0x99260d7389c05df7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042851.830481:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a40031400/0x99260d7389c05df7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042851.848271:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:7630:x1875947267573888:12345-0@lo:253: Request processed in 90433us (90639us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042851.848285:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789042851.849102:0:7630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a520c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7630:1875947267573888:0@lo:253: 10000000:01000000:3.0:1789042851.849118:0:7630:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789042851.849122:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789042851.849123:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789042851.849125:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789042851.849126:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789042851.849139:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789042851.849141:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789042851.849142:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789042851.849143:0:7630:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789042851.849145:0:7630:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789042851.849147:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789042851.849148:0:7630:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789042851.849162:0:7630:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789042851.866183:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789042851.866434:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789042851.866734:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789042851.866885:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789042851.867107:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789042851.868802:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789042851.876824:0:7630:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1789042852.218600:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1789042852.403795:0:7630:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789042852.403804:0:7630:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789042852.407731:0:7630:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789042852.407815:0:7630:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.117@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789042852.407834:0:7630:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789042852.407866:0:7630:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1789042853.237966:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789042854.266904:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789042855.158697:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789042855.158729:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267574272:0@lo:13: 00000100:00100000:1.0:1789042855.158923:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042855.159046:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267574272 00000100:00100000:3.0:1789042855.159057:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267574272 00000100:00100000:3.0:1789042855.159148:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789042855.159161:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267574272:12345-0@lo:13: 00002000:00000024:3.0:1789042855.159207:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789042855.159263:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267574272:12345-0@lo:13: Request processed in 105us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042855.159271:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1789042855.159449:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789042855.159487:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7a8b4700 x1875947267574272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042871 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789042855.159560:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267574272:0@lo:13: 00010000:00010000:3.0:1789042855.285232:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789042856.309104:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789042857.207842:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267574528:0@lo:400: 00000100:00100000:0.0:1789042857.207929:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042857.207995:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789042857.208002:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267574656:0@lo:400: 00000100:00100000:0.0:1789042857.208037:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042857.208582:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267574400:0@lo:400: 00000100:00100000:2.0:1789042857.208625:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042857.208649:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875947267574912:0@lo:400: 00000100:00100000:2.0:1789042857.208670:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042857.208686:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789042857.208692:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267574784:0@lo:400: 00000100:00100000:2.0:1789042857.208718:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042857.208755:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267574400 00000100:00100000:2.0:1789042857.208770:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267574400 00000100:00100000:2.0:1789042857.208820:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789042857.208829:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:3313:x1875947267574400:12345-0@lo:400: 00000100:00100000:2.0:1789042857.208881:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:3313:x1875947267574400:12345-0@lo:400: Request processed in 52us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042857.208889:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789042857.208927:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267574784 00000100:00100000:2.0:1789042857.208930:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267574784 00000100:00100000:2.0:1789042857.208966:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789042857.208973:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267574784:12345-0@lo:400: 00000100:00100000:2.0:1789042857.209004:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267574784:12345-0@lo:400: Request processed in 32us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042857.209022:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789042857.209060:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a52462d80 x1875947267574784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042857.209077:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267574784:0@lo:400: 00000100:00100000:2.0:1789042857.209086:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267574400:0@lo:400: 00000100:00080000:2.0:1789042857.209112:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789042857.212750:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267574528 00000100:00100000:3.0:1789042857.212769:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267574528 00000100:00100000:3.0:1789042857.212848:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267574656 00000100:00100000:3.0:1789042857.212852:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267574656 00000100:00100000:3.0:1789042857.212878:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267574912 00000100:00100000:3.0:1789042857.212882:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267574912 00000100:00100000:3.0:1789042857.212902:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789042857.212912:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267574528:12345-0@lo:400: 00000100:00100000:3.0:1789042857.213055:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267574528:12345-0@lo:400: Request processed in 143us (5125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042857.213063:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789042857.213095:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789042857.213102:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267574656:12345-0@lo:400: 00000100:00100000:3.0:1789042857.213135:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267574656:12345-0@lo:400: Request processed in 33us (5097us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042857.213142:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789042857.213152:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789042857.213158:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75edd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875947267574912:12345-0@lo:400: 00000100:00100000:3.0:1789042857.213192:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75edd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875947267574912:12345-0@lo:400: Request processed in 34us (4521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042857.213198:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1789042857.220448:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789042857.220676:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a52460a80 x1875947267574912/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789042873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042857.220698:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875947267574912:0@lo:400: 00010000:00080000:3.0:1789042857.220777:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a52461180 x1875947267574656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789042873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042857.220789:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267574656:0@lo:400: 00010000:00080000:3.0:1789042857.220803:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a52461c00 x1875947267574528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789042873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042857.220812:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267574528:0@lo:400: 00010000:00010000:3.0:1789042857.334702:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789042858.226611:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789042858.226619:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa06a7924c000 from 30 10000000:01000000:3.0:1789042858.226625:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789042858.226671:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28200/0x99260d7389c05dfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042858.226696:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28200/0x99260d7389c05dfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042858.226709:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28200/0x99260d7389c05dfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042858.226871:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a025180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267575040:0@lo:101: 00000100:00100000:3.0:1789042858.226946:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042858.226997:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7a8fba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789042858.227034:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267575040 00000100:00100000:3.0:1789042858.227042:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267575040 00000100:00100000:3.0:1789042858.227468:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789042858.227479:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:5844:x1875947267575040:12345-0@lo:101: 00010000:00010000:3.0:1789042858.227496:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789042858.227511:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a6fc28c00/0x99260d7389c05e05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05dfe expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042858.227556:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a6fc28c00/0x99260d7389c05e05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05dfe expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042858.227567:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a6fc28c00/0x99260d7389c05e05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05dfe expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042858.227576:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc28c00, rc 0) 00000100:00100000:3.0:1789042858.227617:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+14:5844:x1875947267575040:12345-0@lo:101: Request processed in 141us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042858.227624:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789042858.231702:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a025180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267575040:0@lo:101: 00010000:00010000:0.0:1789042858.231731:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28200/0x99260d7389c05dfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05e05 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042858.231744:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28200/0x99260d7389c05dfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05e05 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042858.231822:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52462300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267575168:0@lo:501: 00000100:00100000:0.0:1789042858.231872:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042858.231916:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa069435553c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789042858.232624:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267575168 00000100:00100000:1.0:1789042858.232633:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267575168 00000100:00100000:1.0:1789042858.232678:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789042858.232686:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+14:5844:x1875947267575168:12345-0@lo:501: 00000100:00100000:1.0:1789042858.233029:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+14:5844:x1875947267575168:12345-0@lo:501: Request processed in 342us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042858.233036:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789042858.233074:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52462300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267575168:0@lo:501: 00000100:00100000:1.0:1789042858.233106:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267575296:0@lo:503: 00000100:00100000:1.0:1789042858.233139:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042858.233153:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a42ebf600 going to sleep for 11 seconds 00000100:00100000:1.0:1789042858.233163:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267575296 00000100:00100000:1.0:1789042858.233165:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267575296 00000100:00100000:1.0:1789042858.233179:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789042858.233184:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+14:5844:x1875947267575296:12345-0@lo:503: 00000100:00100000:1.0:1789042858.233417:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+14:5844:x1875947267575296:12345-0@lo:503: Request processed in 232us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042858.233423:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789042858.233454:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267575296:0@lo:503: 00000100:00100000:1.0:1789042858.234997:0:7887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7887:1875947267575424:0@lo:502: 00000100:00100000:1.0:1789042858.235073:0:7887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042858.235101:0:7887:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a55f720c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789042858.235146:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267575424 00000100:00100000:2.0:1789042858.235152:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267575424 00000100:00100000:2.0:1789042858.235191:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789042858.235199:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+14:7887:x1875947267575424:12345-0@lo:502: 00000100:00100000:2.0:1789042858.235615:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+14:7887:x1875947267575424:12345-0@lo:502: Request processed in 415us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042858.235623:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789042858.235721:0:7887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7887:1875947267575424:0@lo:502: 00000100:00100000:1.0:1789042858.235881:0:7887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7887:1875947267575552:0@lo:502: 00000100:00100000:1.0:1789042858.235910:0:7887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042858.235932:0:7887:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a55f720c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789042858.236579:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267575552 00000100:00100000:2.0:1789042858.236591:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267575552 00000100:00100000:2.0:1789042858.236625:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789042858.236632:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+14:7887:x1875947267575552:12345-0@lo:502: 00000100:00100000:2.0:1789042858.258133:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+14:7887:x1875947267575552:12345-0@lo:502: Request processed in 21490us (22211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042858.258148:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789042858.268258:0:7887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7887:1875947267575552:0@lo:502: 00000040:00080000:1.0:1789042858.268473:0:7887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789042858.269668:0:5844:0:(obd_config.c:2243:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789042858.269707:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789042858.269717:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28200/0x99260d7389c05dfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05e05 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042858.269729:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28200/0x99260d7389c05dfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05e05 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789042858.269739:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789042858.269742:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1789042858.269745:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789042858.269777:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a6fc29200/0x99260d7389c05e0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042858.269785:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a6fc29200/0x99260d7389c05e0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042858.269794:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a6fc29200/0x99260d7389c05e0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042858.269814:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a026d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267575680:0@lo:101: 00000100:00100000:3.0:1789042858.269872:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042858.269909:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a51814780 going to sleep for 11 seconds 00000100:00100000:1.0:1789042858.270489:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267575680 00000100:00100000:1.0:1789042858.270497:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267575680 00000100:00100000:1.0:1789042858.271480:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789042858.271493:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+14:5844:x1875947267575680:12345-0@lo:101: 00010000:00010000:1.0:1789042858.271508:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789042858.271544:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a41686800/0x99260d7389c05e13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05e0c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042858.271572:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a41686800/0x99260d7389c05e13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05e0c expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042858.271584:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a41686800/0x99260d7389c05e13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05e0c expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042858.271594:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41686800, rc 0) 00000100:00100000:1.0:1789042858.271658:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:5844:x1875947267575680:12345-0@lo:101: Request processed in 168us (1786us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042858.271665:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789042858.271766:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a026d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267575680:0@lo:101: 00010000:00010000:0.0:1789042858.271785:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a6fc29200/0x99260d7389c05e0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05e13 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042858.271794:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a6fc29200/0x99260d7389c05e0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05e13 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042858.271869:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52463480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267575808:0@lo:501: 00000100:00100000:0.0:1789042858.271902:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042858.271938:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06943555600 going to sleep for 11 seconds 00000100:00100000:1.0:1789042858.271987:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267575808 00000100:00100000:1.0:1789042858.271993:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267575808 00000100:00100000:1.0:1789042858.272161:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789042858.272170:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:5844:x1875947267575808:12345-0@lo:501: 00000100:00100000:1.0:1789042858.273229:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:5844:x1875947267575808:12345-0@lo:501: Request processed in 1056us (1322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042858.273252:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789042858.274278:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52463480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267575808:0@lo:501: 00000100:00100000:0.0:1789042858.274331:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52463480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267575936:0@lo:503: 00000100:00100000:0.0:1789042858.274388:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042858.274499:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06943555600 going to sleep for 11 seconds 00000100:00100000:2.0:1789042858.275367:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267575936 00000100:00100000:2.0:1789042858.275376:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267575936 00000100:00100000:2.0:1789042858.275425:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789042858.275435:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:5844:x1875947267575936:12345-0@lo:503: 00000100:00100000:2.0:1789042858.275806:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:5844:x1875947267575936:12345-0@lo:503: Request processed in 370us (1416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042858.275814:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789042858.275868:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52463480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267575936:0@lo:503: 00000100:00100000:2.0:1789042858.276103:0:7891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75edf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7891:1875947267576064:0@lo:502: 00000100:00100000:2.0:1789042858.276140:0:7891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042858.276161:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267576064 00000100:00100000:2.0:1789042858.276165:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267576064 00000100:00100000:2.0:1789042858.276182:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789042858.276188:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:7891:x1875947267576064:12345-0@lo:502: 00000100:00100000:2.0:1789042858.276335:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:7891:x1875947267576064:12345-0@lo:502: Request processed in 146us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042858.276342:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789042858.276370:0:7891:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a45627900 going to sleep for 11 seconds 00000100:00100000:2.0:1789042858.276382:0:7891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75edf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7891:1875947267576064:0@lo:502: 00000020:01000000:2.0:1789042858.276400:0:7891:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789042858.276412:0:7891:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789042858.276415:0:7891:0:(obd_config.c:1661:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789042858.276420:0:7891:0:(obd_config.c:1570:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789042858.276422:0:7891:0:(obd_config.c:1635:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789042858.276435:0:7891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75edf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7891:1875947267576192:0@lo:502: 00000100:00100000:2.0:1789042858.276462:0:7891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042858.276479:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267576192 00000100:00100000:2.0:1789042858.276482:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267576192 00000100:00100000:2.0:1789042858.276497:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789042858.276502:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:7891:x1875947267576192:12345-0@lo:502: 00000100:00100000:2.0:1789042858.276618:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:7891:x1875947267576192:12345-0@lo:502: Request processed in 115us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042858.276626:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789042858.276649:0:7891:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a45627900 going to sleep for 11 seconds 00000100:00100000:2.0:1789042858.276659:0:7891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75edf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7891:1875947267576192:0@lo:502: 00000020:01000000:2.0:1789042858.276674:0:7891:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789042858.276678:0:7891:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789042858.277917:0:7891:0:(obd_config.c:1661:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789042858.277927:0:7891:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1789042858.277998:0:5844:0:(obd_config.c:2243:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1789042858.278027:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789042858.278038:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a6fc29200/0x99260d7389c05e0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05e13 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042858.278049:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a6fc29200/0x99260d7389c05e0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05e13 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789042858.278059:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789042858.278062:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa06a52b8e800 from 30 10000000:01000000:2.0:1789042858.278077:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789042858.278119:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a58604200/0x99260d7389c05e1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042858.278127:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a58604200/0x99260d7389c05e1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042858.278137:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a58604200/0x99260d7389c05e1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042858.278155:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75edf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267576320:0@lo:101: 00000100:00100000:2.0:1789042858.278197:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042858.278216:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a45627900 going to sleep for 11 seconds 00000100:00100000:2.0:1789042858.278233:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267576320 00000100:00100000:2.0:1789042858.278238:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267576320 00000100:00100000:2.0:1789042858.278264:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789042858.278272:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:5844:x1875947267576320:12345-0@lo:101: 00010000:00010000:2.0:1789042858.278281:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789042858.278292:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a58605c00/0x99260d7389c05e21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05e1a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042858.278314:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a58605c00/0x99260d7389c05e21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05e1a expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042858.278325:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a58605c00/0x99260d7389c05e21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05e1a expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042858.278334:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a58605c00, rc 0) 00000100:00100000:2.0:1789042858.278363:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:5844:x1875947267576320:12345-0@lo:101: Request processed in 91us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042858.278378:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789042858.280579:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75edf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267576320:0@lo:101: 00010000:00010000:2.0:1789042858.280604:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a58604200/0x99260d7389c05e1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05e21 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042858.280616:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a58604200/0x99260d7389c05e1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05e21 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042858.280679:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75edf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267576448:0@lo:501: 00000100:00100000:2.0:1789042858.280724:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042858.280750:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a45627900 going to sleep for 11 seconds 00000100:00100000:2.0:1789042858.280767:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267576448 00000100:00100000:2.0:1789042858.280771:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267576448 00000100:00100000:2.0:1789042858.280799:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789042858.280807:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:5844:x1875947267576448:12345-0@lo:501: 00000100:00100000:2.0:1789042858.281048:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:5844:x1875947267576448:12345-0@lo:501: Request processed in 240us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042858.281055:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789042858.281091:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75edf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267576448:0@lo:501: 00000100:00100000:2.0:1789042858.281114:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75edf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267576576:0@lo:503: 00000100:00100000:2.0:1789042858.281149:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042858.281162:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a45627900 going to sleep for 11 seconds 00000100:00100000:2.0:1789042858.281173:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267576576 00000100:00100000:2.0:1789042858.281176:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267576576 00000100:00100000:2.0:1789042858.281191:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789042858.281196:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:5844:x1875947267576576:12345-0@lo:503: 00000100:00100000:2.0:1789042858.281328:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:5844:x1875947267576576:12345-0@lo:503: Request processed in 131us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042858.281335:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789042858.281367:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75edf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267576576:0@lo:503: 00000100:00100000:0.0:1789042858.296211:0:7892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52460380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7892:1875947267576704:0@lo:502: 00000100:00100000:0.0:1789042858.296292:0:7892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042858.296329:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267576704 00000100:00100000:0.0:1789042858.296337:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267576704 00000100:00100000:0.0:1789042858.296376:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789042858.296384:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:7892:x1875947267576704:12345-0@lo:502: 00000100:00100000:0.0:1789042858.300854:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:7892:x1875947267576704:12345-0@lo:502: Request processed in 4464us (4555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042858.300867:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789042858.300939:0:7892:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06943555cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789042858.300965:0:7892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52460380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7892:1875947267576704:0@lo:502: 00000100:00100000:0.0:1789042858.301037:0:7892:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52460380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7892:1875947267576832:0@lo:502: 00000100:00100000:0.0:1789042858.301077:0:7892:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042858.301109:0:7892:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06943555cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789042858.301195:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267576832 00000100:00100000:2.0:1789042858.301203:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267576832 00000100:00100000:2.0:1789042858.301244:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789042858.301253:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:7892:x1875947267576832:12345-0@lo:502: 00000100:00100000:2.0:1789042858.301407:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:7892:x1875947267576832:12345-0@lo:502: Request processed in 154us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042858.301414:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789042858.301562:0:7892:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52460380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7892:1875947267576832:0@lo:502: 00000040:00080000:0.0:1789042858.301580:0:7892:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789042858.301749:0:5844:0:(obd_config.c:2243:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789042858.301765:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789042858.301775:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a58604200/0x99260d7389c05e1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05e21 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042858.301786:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a58604200/0x99260d7389c05e1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05e21 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789042858.301796:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789042858.301799:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa06a52b8e800 from 5 10000000:01000000:2.0:1789042858.301803:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789042858.301826:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a58605a00/0x99260d7389c05e28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042858.301834:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a58605a00/0x99260d7389c05e28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042858.301855:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a58605a00/0x99260d7389c05e28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042858.301869:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75edf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267576960:0@lo:101: 00000100:00100000:2.0:1789042858.301896:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042858.301915:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a456270c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789042858.302220:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267576960 00000100:00100000:0.0:1789042858.302225:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267576960 00000100:00100000:0.0:1789042858.302259:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789042858.302266:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:5844:x1875947267576960:12345-0@lo:101: 00010000:00010000:0.0:1789042858.302275:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789042858.302288:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a40030e00/0x99260d7389c05e2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05e28 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042858.302311:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a40030e00/0x99260d7389c05e2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05e28 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042858.302322:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a40030e00/0x99260d7389c05e2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05e28 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042858.302331:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a40030e00, rc 0) 00000100:00100000:0.0:1789042858.302374:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:5844:x1875947267576960:12345-0@lo:101: Request processed in 108us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042858.302380:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789042858.305596:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75edf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267576960:0@lo:101: 00010000:00010000:3.0:1789042858.305626:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a58605a00/0x99260d7389c05e28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05e2f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042858.305641:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a58605a00/0x99260d7389c05e28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05e2f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042858.305718:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a025880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267577088:0@lo:256: 00000100:00100000:3.0:1789042858.305780:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042858.305822:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a51814900 going to sleep for 11 seconds 00000100:00100000:2.0:1789042858.305928:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267577088 00000100:00100000:2.0:1789042858.305936:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267577088 00000100:00100000:2.0:1789042858.305975:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789042858.305983:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46e78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:5844:x1875947267577088:12345-0@lo:256: 20000000:01000000:2.0:1789042858.306013:0:5839:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789042858.306029:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789042858.306033:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1789042858.306110:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46e78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:5844:x1875947267577088:12345-0@lo:256: Request processed in 126us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042858.306118:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789042858.306199:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a025880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267577088:0@lo:256: 10000000:01000000:3.0:1789042858.306237:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789042858.306244:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a58605a00/0x99260d7389c05e28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05e2f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042858.306253:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a58605a00/0x99260d7389c05e28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05e2f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789042858.306262:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789042858.306264:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1789042858.306267:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789042858.306288:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28a00/0x99260d7389c05e36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042858.306296:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28a00/0x99260d7389c05e36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042858.306305:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28a00/0x99260d7389c05e36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042858.306318:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a025880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267577216:0@lo:101: 00000100:00100000:3.0:1789042858.306341:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042858.306367:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a51814900 going to sleep for 11 seconds 00000100:00100000:2.0:1789042858.306482:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267577216 00000100:00100000:2.0:1789042858.306487:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267577216 00000100:00100000:2.0:1789042858.306504:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789042858.306510:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:5844:x1875947267577216:12345-0@lo:101: 00010000:00010000:2.0:1789042858.306543:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789042858.306556:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a58605000/0x99260d7389c05e3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05e36 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042858.306575:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a58605000/0x99260d7389c05e3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05e36 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042858.306585:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a58605000/0x99260d7389c05e3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05e36 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042858.306599:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a58605000, rc 0) 00000100:00100000:2.0:1789042858.306625:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:5844:x1875947267577216:12345-0@lo:101: Request processed in 115us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042858.306630:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789042858.315703:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a025880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267577216:0@lo:101: 00010000:00010000:3.0:1789042858.315735:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28a00/0x99260d7389c05e36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05e3d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042858.315765:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28a00/0x99260d7389c05e36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05e3d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042858.315845:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a025880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267577344:0@lo:501: 00000100:00100000:3.0:1789042858.315904:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042858.315940:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a51814900 going to sleep for 11 seconds 00000100:00100000:3.0:1789042858.315959:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267577344 00000100:00100000:3.0:1789042858.315964:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267577344 00000100:00100000:3.0:1789042858.316012:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789042858.316021:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:5844:x1875947267577344:12345-0@lo:501: 00000100:00100000:3.0:1789042858.316262:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:5844:x1875947267577344:12345-0@lo:501: Request processed in 241us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042858.316271:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789042858.316307:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a025880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267577344:0@lo:501: 00000100:00100000:3.0:1789042858.316331:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a025880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267577472:0@lo:503: 00000100:00100000:3.0:1789042858.316365:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042858.316380:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a51814900 going to sleep for 11 seconds 00000100:00100000:3.0:1789042858.316404:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267577472 00000100:00100000:3.0:1789042858.316408:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267577472 00000100:00100000:3.0:1789042858.316428:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789042858.316435:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:5844:x1875947267577472:12345-0@lo:503: 00000100:00100000:3.0:1789042858.316733:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:5844:x1875947267577472:12345-0@lo:503: Request processed in 298us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042858.316740:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789042858.316776:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a025880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267577472:0@lo:503: 00000100:00100000:3.0:1789042858.324752:0:7893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a025880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7893:1875947267577600:0@lo:502: 00000100:00100000:3.0:1789042858.324835:0:7893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042858.324874:0:7893:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a51814900 going to sleep for 11 seconds 00000100:00100000:2.0:1789042858.324975:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267577600 00000100:00100000:2.0:1789042858.324983:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267577600 00000100:00100000:2.0:1789042858.325030:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789042858.325039:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:7893:x1875947267577600:12345-0@lo:502: 00000100:00100000:2.0:1789042858.325371:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:7893:x1875947267577600:12345-0@lo:502: Request processed in 332us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042858.325380:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789042858.325565:0:7893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a025880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7893:1875947267577600:0@lo:502: 00000020:01000000:1.0:1789042858.325595:0:7893:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789042858.325603:0:7893:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789042858.325610:0:7893:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789042858.325613:0:7893:0:(obd_config.c:1661:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789042858.325617:0:7893:0:(obd_config.c:1570:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789042858.325621:0:7893:0:(obd_config.c:1585:class_process_config()) adding mapping from uuid 192.168.203.117@tcp to nid 0x20000c0a8cb75 (192.168.203.117@tcp) 00000020:01000000:1.0:1789042858.325641:0:7893:0:(obd_config.c:2072:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789042858.325644:0:7893:0:(obd_config.c:1570:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789042858.325658:0:7893:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffffa06a7732cd88) 00000020:00000080:1.0:1789042858.325678:0:7893:0:(obd_config.c:786:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1789042858.325683:0:7893:0:(obd_config.c:1570:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789042858.325753:0:7893:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789042858.325759:0:7893:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789042858.325766:0:7893:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x99260d7389c05e4b 00010000:00080000:1.0:1789042858.325794:0:7893:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa06a45300000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.117@tcp at head 00010000:00010000:1.0:1789042858.326040:0:7893:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1789042858.326360:0:7893:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1789042858.326373:0:7893:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789042858.331653:0:7893:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789042858.332010:0:7893:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789042858.332079:0:7893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1789042858.332135:0:7893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1789042858.333496:0:7894:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789042858.333503:0:7894:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789042858.339839:0:7893:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789042858.339854:0:7893:0:(obd_config.c:1570:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789042858.339890:0:7893:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789042858.339913:0:7893:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x99260d7389c05e52 00000100:00080000:3.0:1789042858.339923:0:7893:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789042858.339929:0:7893:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa06a45300000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:3.0:1789042858.339962:0:7893:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa06a7a025880 x1875947267577728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789042858.339985:0:7893:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789042858.340041:0:7893:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789042858.340045:0:7893:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789042858.340047:0:7893:0:(obd_config.c:1661:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789042858.340050:0:7893:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789042858.340054:0:7893:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789042858.340056:0:7893:0:(obd_config.c:1661:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789042858.340059:0:7893:0:(obd_config.c:1570:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789042858.340061:0:7893:0:(obd_config.c:1635:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789042858.340086:0:7893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a026d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7893:1875947267577856:0@lo:502: 00000100:00100000:3.0:1789042858.340156:0:7893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042858.340191:0:7893:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a51814240 going to sleep for 11 seconds 00000100:00100000:3.0:1789042858.340208:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875947267577728:0@lo:8: 00000100:00100000:3.0:1789042858.340236:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042858.340309:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267577984:0@lo:400: 00000100:00100000:3.0:1789042858.340335:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042858.340353:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789042858.340365:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267578112:0@lo:400: 00000100:00100000:3.0:1789042858.340386:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042858.340674:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267578240:0@lo:400: 00000100:00100000:3.0:1789042858.340699:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042858.340718:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789042858.341474:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875947267578368:0@lo:400: 00000100:00100000:3.0:1789042858.341506:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042858.341561:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267577984 00000100:00100000:3.0:1789042858.341568:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267577984 00000100:00100000:3.0:1789042858.341606:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267578112 00000100:00100000:3.0:1789042858.341609:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267578112 00000100:00100000:3.0:1789042858.341620:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267578368 00000100:00100000:3.0:1789042858.341622:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267578368 00000100:00100000:3.0:1789042858.341635:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789042858.341643:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267577984:12345-0@lo:400: 00000100:00100000:3.0:1789042858.341695:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267577984:12345-0@lo:400: Request processed in 52us (1358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042858.341701:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789042858.341716:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789042858.341723:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267578112:12345-0@lo:400: 00000100:00100000:3.0:1789042858.342260:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267578112:12345-0@lo:400: Request processed in 537us (1872us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042858.342267:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789042858.342282:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789042858.342289:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875947267578368:12345-0@lo:400: 00000100:00100000:3.0:1789042858.342328:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875947267578368:12345-0@lo:400: Request processed in 40us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042858.342344:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789042858.342369:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267577728 00000100:00100000:3.0:1789042858.342374:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267577728 00000100:00100000:3.0:1789042858.342547:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267578240 00000100:00100000:3.0:1789042858.342552:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267578240 00000100:00100000:3.0:1789042858.342571:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789042858.342578:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267578240:12345-0@lo:400: 00000100:00100000:3.0:1789042858.342609:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267578240:12345-0@lo:400: Request processed in 32us (1909us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042858.342615:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789042858.342625:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789042858.342629:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a025180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3311:x1875947267577728:12345-0@lo:8: 00010000:00080000:3.0:1789042858.342653:0:6690:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:3.0:1789042858.342677:0:6690:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x99260d7389c05e59 00002000:00100000:3.0:1789042858.342691:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffffa06a6fe4a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789042858.342695:0:6690:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1789042858.342699:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00080000:2.0:1789042858.342841:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7a027480 x1875947267578368/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789042874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042858.342856:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875947267578368:0@lo:400: 00010000:00080000:2.0:1789042858.342868:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7a027b80 x1875947267578240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042858.342878:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267578240:0@lo:400: 00002000:00100000:3.0:1789042858.343019:0:6690:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789042858.343221:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789042858.343244:0:6690:0:(import.c:65:import_set_state_nolock()) ffffa06a6fe4e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789042858.343326:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a025180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1875947267577728:12345-0@lo:8: Request processed in 694us (3089us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042858.343334:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789042858.343375:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7a024380 x1875947267578112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789042874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042858.343386:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267578112:0@lo:400: 00010000:00080000:3.0:1789042858.343418:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7a024700 x1875947267577984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789042874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042858.343427:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267577984:0@lo:400: 00000100:00100000:0.0:1789042858.345558:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267577856 00000100:00100000:0.0:1789042858.345570:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267577856 00000100:00100000:0.0:1789042858.345618:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789042858.345627:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:7893:x1875947267577856:12345-0@lo:502: 00000100:00100000:0.0:1789042858.345883:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:7893:x1875947267577856:12345-0@lo:502: Request processed in 256us (5726us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042858.345891:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789042858.346539:0:7893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a026d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:7893:1875947267577856:0@lo:502: 00000020:01000000:3.0:1789042858.346572:0:7893:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789042858.346579:0:7893:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789042858.346581:0:7893:0:(obd_config.c:1661:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789042858.346585:0:7893:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1789042858.349498:0:5844:0:(obd_config.c:2243:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1789042858.349552:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789042858.349564:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28a00/0x99260d7389c05e36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05e3d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042858.349590:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28a00/0x99260d7389c05e36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05e3d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789042858.349601:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789042858.349604:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffffa06a5209cd88 from 1 10000000:01000000:0.0:1789042858.349607:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789042858.349642:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05e60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042858.349650:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05e60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042858.349662:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05e60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042858.349683:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52460380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267578496:0@lo:101: 00000100:00100000:0.0:1789042858.349806:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042858.349845:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa069435550c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789042858.349865:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267578496 00000100:00100000:0.0:1789042858.349871:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267578496 00000100:00100000:0.0:1789042858.349908:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789042858.349916:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:5844:x1875947267578496:12345-0@lo:101: 00010000:00010000:0.0:1789042858.349927:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789042858.349938:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a40031a00/0x99260d7389c05e67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05e60 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042858.349962:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a40031a00/0x99260d7389c05e67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05e60 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042858.349984:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a40031a00/0x99260d7389c05e67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05e60 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042858.349992:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a40031a00, rc 0) 00000100:00100000:0.0:1789042858.350038:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:5844:x1875947267578496:12345-0@lo:101: Request processed in 121us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042858.350045:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789042858.350089:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52460380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267578496:0@lo:101: 00010000:00010000:0.0:1789042858.350103:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05e60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05e67 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042858.350112:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05e60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05e67 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042858.350155:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52460380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267578624:0@lo:501: 00000100:00100000:0.0:1789042858.350177:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042858.350189:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa069435550c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789042858.350201:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267578624 00000100:00100000:0.0:1789042858.350204:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267578624 00000100:00100000:0.0:1789042858.350221:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789042858.350227:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:5844:x1875947267578624:12345-0@lo:501: 00010000:00080000:2.0:1789042858.352012:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7a025880 x1875947267577728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789042868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042858.352027:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789042858.352036:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789042858.352045:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789042858.352051:0:3311:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789042858.352054:0:3311:0:(import.c:65:import_set_state_nolock()) ffffa06a45300000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789042858.352084:0:3311:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789042858.352091:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875947267577728:0@lo:8: 00000100:00100000:0.0:1789042858.352571:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:5844:x1875947267578624:12345-0@lo:501: Request processed in 2341us (2390us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789042858.352582:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789042858.352629:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52460380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267578624:0@lo:501: 10000000:01000000:0.0:1789042858.352666:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789042858.352682:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05e60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05e67 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042858.352692:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05e60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05e67 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042858.368525:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789042858.380297:0:7894:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789042858.380619:0:7894:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 201337103662ns, next at 0ns, rc = 0 00000004:00080000:3.0:1789042858.448148:0:7895:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789042858.448175:0:7895:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a024700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7895:1875947267578880:0@lo:7: 00000100:00100000:3.0:1789042858.448231:0:7895:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042858.448263:0:7895:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a51814780 going to sleep for 11 seconds 00000100:00100000:3.0:1789042858.448277:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267578752:0@lo:13: 00000100:00100000:3.0:1789042858.448298:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042858.448328:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267578880 00000100:00100000:3.0:1789042858.448334:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267578880 00000100:00100000:3.0:1789042858.448375:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789042858.448382:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a024380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7895:x1875947267578880:12345-0@lo:7: 00000100:00100000:2.0:1789042858.456647:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267578752 00000100:00100000:2.0:1789042858.456660:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267578752 00000100:00100000:2.0:1789042858.456721:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789042858.456836:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875947267578752:12345-0@lo:13: 00002000:00000024:2.0:1789042858.456868:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1789042858.456942:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875947267578752:12345-0@lo:13: Request processed in 111us (8643us total) trans 0 rc 0/0 00000100:00080000:3.0:1789042858.457561:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789042858.457606:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7a026d80 x1875947267578752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042874 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042858.457629:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267578752:0@lo:13: 00002000:00080000:3.0:1789042858.458492:0:6690:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1789042858.458498:0:6690:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789042858.458586:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a024380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7895:x1875947267578880:12345-0@lo:7: Request processed in 10201us (10351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042858.458601:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789042858.458642:0:7895:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7a024700 x1875947267578880/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789042874 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042858.458654:0:7895:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a024700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7895:1875947267578880:0@lo:7: 00000004:00080000:3.0:1789042858.458664:0:7895:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789042858.458699:0:7895:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a024700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7895:1875947267579008:0@lo:5: 00000100:00100000:3.0:1789042858.458732:0:7895:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042858.458765:0:7895:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a51814780 going to sleep for 11 seconds 00000100:00100000:3.0:1789042858.458780:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267579008 00000100:00100000:3.0:1789042858.458786:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267579008 00000100:00100000:3.0:1789042858.458816:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789042858.458824:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a026d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7895:x1875947267579008:12345-0@lo:5: 00002000:00080000:3.0:1789042858.458845:0:6692:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1789042858.458849:0:6692:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1789042858.459062:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a026d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:7895:x1875947267579008:12345-0@lo:5: Request processed in 238us (329us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789042858.459069:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789042858.459096:0:7895:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7a024700 x1875947267579008/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789042874 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042858.459108:0:7895:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a024700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7895:1875947267579008:0@lo:5: 00000004:00080000:3.0:1789042858.459116:0:7895:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789042858.459136:0:7895:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a027b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7895:1875947267579136:0@lo:700: 00000100:00100000:3.0:1789042858.459159:0:7895:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042858.459174:0:7895:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a51814780 going to sleep for 11 seconds 00000100:00100000:3.0:1789042858.459185:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267579136 00000100:00100000:3.0:1789042858.459194:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267579136 00000100:00100000:3.0:1789042858.459218:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789042858.459224:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a027480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+8:7895:x1875947267579136:12345-0@lo:700: 00000100:00100000:3.0:1789042858.459259:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06942106300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6698:1875947267579264:0@lo:700: 00000100:00100000:3.0:1789042858.459284:0:6698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042858.459301:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a51814240 going to sleep for 11 seconds 00000100:00100000:3.0:1789042858.459320:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267579264 00000100:00100000:3.0:1789042858.459323:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267579264 00000100:00100000:3.0:1789042858.459349:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789042858.459355:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6698:x1875947267579264:12345-0@lo:700: 00000100:00100000:2.0:1789042858.461255:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:0.0:1789042858.515837:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:1.0:1789042858.562089:0:5852:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1789042858.569335:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6698:x1875947267579264:12345-0@lo:700: Request processed in 109974us (110043us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042858.569362:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789042858.569938:0:6698:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06942106300 x1875947267579264/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789042874 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042858.569953:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06942106300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6698:1875947267579264:0@lo:700: 40000000:02000000:3.0:1789042858.569967:0:6698:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:3.0:1789042858.696156:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a027480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7895:x1875947267579136:12345-0@lo:700: Request processed in 236924us (236988us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042858.696169:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789042858.696217:0:7895:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7a027b80 x1875947267579136/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789042874 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042858.696231:0:7895:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a027b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7895:1875947267579136:0@lo:700: 00000001:00080000:1.0:1789042858.698356:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1789042858.698372:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:3.0:1789042858.812094:0:7895:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1789042858.817063:0:7895:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06942106300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7895:1875947267579392:0@lo:5: 00000100:00100000:3.0:1789042858.817134:0:7895:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042858.817218:0:7895:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7726c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789042858.817342:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267579392 00000100:00100000:0.0:1789042858.817350:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267579392 00000100:00100000:0.0:1789042858.817402:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789042858.817413:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942104380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7895:x1875947267579392:12345-0@lo:5: 00002000:00080000:0.0:1789042858.824324:0:6692:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1789042858.824342:0:6692:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1789042858.827180:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942104380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7895:x1875947267579392:12345-0@lo:5: Request processed in 9761us (10039us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789042858.827194:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789042858.827311:0:7895:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06942106300 x1875947267579392/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789042874 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042858.827332:0:7895:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789042858.827349:0:7895:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffffa06942106300 x1875947267579392/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789042874 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042858.827361:0:7895:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06942106300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7895:1875947267579392:0@lo:5: 00000004:00080000:3.0:1789042858.827376:0:7895:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1789042859.386656:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789042860.087903:0:7996:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789042860.284096:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789042860.284122:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267579520:0@lo:13: 00000100:00100000:0.0:1789042860.284192:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042860.284258:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267579520 00000100:00100000:0.0:1789042860.284265:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267579520 00000100:00100000:0.0:1789042860.284317:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789042860.284327:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267579520:12345-0@lo:13: 00002000:00000024:0.0:1789042860.284365:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789042860.284424:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267579520:12345-0@lo:13: Request processed in 98us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042860.284431:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1789042860.284451:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789042860.284492:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a52460380 x1875947267579520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042876 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042860.284540:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267579520:0@lo:13: 00010000:00010000:0.0:1789042860.410882:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789042861.429041:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789042862.453311:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789042863.346982:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267579904:0@lo:400: 00000100:00100000:0.0:1789042863.347049:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042863.347158:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875947267579776:0@lo:400: 00000100:00100000:3.0:1789042863.347201:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042863.347230:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789042863.347236:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267579648:0@lo:400: 00000100:00100000:3.0:1789042863.347263:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042863.347297:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267579904 00000100:00100000:3.0:1789042863.347305:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267579904 00000100:00100000:3.0:1789042863.347356:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267579776 00000100:00100000:3.0:1789042863.347359:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267579776 00000100:00100000:3.0:1789042863.347377:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789042863.347399:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52460380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267579904:12345-0@lo:400: 00000100:00100000:2.0:1789042863.349003:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267580032:0@lo:400: 00000100:00100000:2.0:1789042863.349057:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042863.349161:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789042863.349173:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942105f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875947267579776:12345-0@lo:400: 00000100:00100000:2.0:1789042863.349222:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942105f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875947267579776:12345-0@lo:400: Request processed in 53us (2021us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042863.349229:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1789042863.349278:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7a8b4000 x1875947267579776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789042879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042863.349291:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875947267579776:0@lo:400: 00000100:00100000:2.0:1789042863.349330:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267580032 00000100:00100000:2.0:1789042863.349335:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267580032 00000100:00100000:2.0:1789042863.349821:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789042863.349830:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75edf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267580032:12345-0@lo:400: 00000100:00100000:2.0:1789042863.349884:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75edf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267580032:12345-0@lo:400: Request processed in 56us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042863.349891:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789042863.349916:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7a8b5180 x1875947267580032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042863.349926:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267580032:0@lo:400: 00000100:00100000:2.0:1789042863.349977:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267579648 00000100:00100000:2.0:1789042863.349982:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267579648 00000100:00100000:2.0:1789042863.350013:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789042863.350019:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267579648:12345-0@lo:400: 00000100:00100000:2.0:1789042863.350056:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267579648:12345-0@lo:400: Request processed in 37us (2792us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042863.350062:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789042863.350095:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267579648:0@lo:400: 00000100:00080000:2.0:1789042863.350120:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789042863.350125:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789042863.350702:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7a8b4700 x1875947267579904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789042879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042863.350711:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267579904:0@lo:400: 00000100:00100000:3.0:1789042863.350714:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52460380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267579904:12345-0@lo:400: Request processed in 3316us (3652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042863.350726:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789042863.350999:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875947267580160:0@lo:400: 00000100:00100000:2.0:1789042863.351032:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042863.351069:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267580288:0@lo:400: 00000100:00100000:3.0:1789042863.351101:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042863.351187:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267580288 00000100:00100000:1.0:1789042863.351193:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267580288 00000100:00100000:1.0:1789042863.351239:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789042863.351252:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942105880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1875947267580288:12345-0@lo:400: 00000100:00100000:1.0:1789042863.351294:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942105880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1875947267580288:12345-0@lo:400: Request processed in 48us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042863.351301:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789042863.351333:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7a8b4700 x1875947267580288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789042863.351344:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267580288:0@lo:400: 00000100:00100000:0.0:1789042863.351381:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267580160 00000100:00100000:0.0:1789042863.351396:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267580160 00000100:00080000:2.0:1789042863.351410:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789042863.351415:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789042863.351487:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789042863.351496:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75edca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875947267580160:12345-0@lo:400: 00000100:00100000:0.0:1789042863.351558:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75edca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875947267580160:12345-0@lo:400: Request processed in 63us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042863.351564:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1789042863.351619:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7a8b6d80 x1875947267580160/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789042879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042863.351629:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875947267580160:0@lo:400: 00010000:00010000:2.0:1789042863.478668:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789042863.860777:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267580416:0@lo:13: 00000100:00100000:0.0:1789042863.860887:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042863.860981:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267580416 00000100:00100000:2.0:1789042863.861019:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267580416 00000100:00100000:2.0:1789042863.861091:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789042863.861103:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875947267580416:12345-0@lo:13: 00002000:00000024:2.0:1789042863.861166:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789042863.861221:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875947267580416:12345-0@lo:13: Request processed in 121us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042863.861228:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789042863.861476:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a52461880 x1875947267580416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042879 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042863.861499:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267580416:0@lo:13: 00000001:00080000:1.0:1789042863.996993:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1789042864.517201:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789042865.395813:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267580544:0@lo:13: 00000100:00100000:1.0:1789042865.395885:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042865.396074:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267580544 00000100:00100000:0.0:1789042865.396082:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267580544 00000100:00100000:0.0:1789042865.396147:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789042865.396170:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267580544:12345-0@lo:13: 00002000:00000024:0.0:1789042865.396207:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789042865.396253:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267580544:12345-0@lo:13: Request processed in 86us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042865.396259:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1789042865.396303:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a52461880 x1875947267580544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042881 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042865.396324:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267580544:0@lo:13: 00000100:00080000:1.0:1789042865.396392:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789042865.523862:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789042866.548130:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789042867.225131:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042867.237211:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242389632 00000100:00100000:2.0:1789042867.237232:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242389632 00000100:00100000:2.0:1789042867.237304:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 114 00000100:00100000:2.0:1789042867.237314:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2348:x1875947242389632:12345-192.168.203.17@tcp:250: 00010000:00080000:2.0:1789042867.237351:0:5839:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e30fd60e-ee3c-46d4-a0cf-f36638a67c48@192.168.203.17@tcp t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:2.0:1789042867.237389:0:5839:0:(genops.c:1393:class_connect()) connect: client e30fd60e-ee3c-46d4-a0cf-f36638a67c48, cookie 0x99260d7389c05e6e 00000100:00080000:2.0:1789042867.237602:0:5839:0:(import.c:65:import_set_state_nolock()) ffffa069412e8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789042867.237698:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+5:2348:x1875947242389632:12345-192.168.203.17@tcp:250: Request processed in 382us (12579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042867.238492:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 114 00000100:00100000:2.0:1789042867.251671:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042867.251992:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242389760 00000100:00100000:3.0:1789042867.252004:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242389760 00000100:00100000:3.0:1789042867.252069:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 115 00000100:00100000:3.0:1789042867.252080:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+5:5580:x1875947242389760:12345-192.168.203.17@tcp:101: 00010000:00010000:3.0:1789042867.252117:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789042867.252139:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a6fc28800/0x99260d7389c05e75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca6767be expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042867.252177:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a6fc28800/0x99260d7389c05e75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6767be expref: 6 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042867.252190:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a6fc28800/0x99260d7389c05e75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6767be expref: 6 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042867.252199:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc28800, rc 0) 00000100:00100000:3.0:1789042867.252275:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+6:5580:x1875947242389760:12345-192.168.203.17@tcp:101: Request processed in 197us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042867.252282:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 115 00000100:00100000:3.0:1789042867.259124:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042867.259174:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242389888 00000100:00100000:3.0:1789042867.259187:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242389888 00000100:00100000:3.0:1789042867.259243:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 116 00000100:00100000:3.0:1789042867.259254:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+6:5580:x1875947242389888:12345-192.168.203.17@tcp:501: 00000100:00100000:3.0:1789042867.259823:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+6:5580:x1875947242389888:12345-192.168.203.17@tcp:501: Request processed in 568us (711us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789042867.259834:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 116 00000100:00100000:0.0:1789042867.263056:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042867.263142:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242390016 00000100:00100000:3.0:1789042867.263155:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242390016 00000100:00100000:3.0:1789042867.263222:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 117 00000100:00100000:3.0:1789042867.263234:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+6:5580:x1875947242390016:12345-192.168.203.17@tcp:101: 00010000:00010000:3.0:1789042867.263253:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789042867.263290:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a6fc28e00/0x99260d7389c05e7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca6767c5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042867.263325:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a6fc28e00/0x99260d7389c05e7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6767c5 expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042867.263337:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a6fc28e00/0x99260d7389c05e7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6767c5 expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042867.263347:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc28e00, rc 0) 00000100:00100000:3.0:1789042867.263426:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+7:5580:x1875947242390016:12345-192.168.203.17@tcp:101: Request processed in 184us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042867.263433:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 117 00000100:00100000:0.0:1789042867.269053:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042867.269902:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242390144 00000100:00100000:3.0:1789042867.269918:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242390144 00000100:00100000:3.0:1789042867.270009:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 118 00000100:00100000:3.0:1789042867.270022:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+7:5580:x1875947242390144:12345-192.168.203.17@tcp:501: 00000100:00100000:3.0:1789042867.270413:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+8:5580:x1875947242390144:12345-192.168.203.17@tcp:501: Request processed in 386us (1365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042867.270424:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 118 00000100:00100000:2.0:1789042867.278637:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042867.278869:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242390272 00000100:00100000:0.0:1789042867.278884:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242390272 00000100:00100000:0.0:1789042867.278958:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 119 00000100:00100000:0.0:1789042867.278969:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+8:5580:x1875947242390272:12345-192.168.203.17@tcp:503: 00000100:00100000:0.0:1789042867.279263:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+8:5580:x1875947242390272:12345-192.168.203.17@tcp:503: Request processed in 294us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042867.279271:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 119 00000100:00100000:3.0:1789042867.288590:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042867.289112:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242390400 00000100:00100000:1.0:1789042867.289126:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242390400 00000100:00100000:1.0:1789042867.289192:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 120 00000100:00100000:1.0:1789042867.289205:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+8:5600:x1875947242390400:12345-192.168.203.17@tcp:502: 00000100:00100000:1.0:1789042867.289751:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+8:5600:x1875947242390400:12345-192.168.203.17@tcp:502: Request processed in 547us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042867.289772:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 120 00000100:00100000:3.0:1789042867.330799:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042867.330852:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242390528 00000100:00100000:3.0:1789042867.330865:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242390528 00000100:00100000:3.0:1789042867.330926:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 121 00000100:00100000:3.0:1789042867.330946:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+8:5600:x1875947242390528:12345-192.168.203.17@tcp:502: 00000100:00100000:3.0:1789042867.331645:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+8:5600:x1875947242390528:12345-192.168.203.17@tcp:502: Request processed in 706us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042867.331671:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 121 00000100:00100000:0.0:1789042867.360105:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042867.365480:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242390656 00000100:00100000:3.0:1789042867.365503:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242390656 00000100:00100000:3.0:1789042867.365648:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 122 00000100:00100000:3.0:1789042867.365662:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a472e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+8:5580:x1875947242390656:12345-192.168.203.17@tcp:101: 00010000:00010000:3.0:1789042867.365684:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789042867.365710:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a6fc28600/0x99260d7389c05e83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca6767ef expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042867.365749:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a6fc28600/0x99260d7389c05e83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6767ef expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042867.365761:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a6fc28600/0x99260d7389c05e83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6767ef expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042867.365772:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc28600, rc 0) 00000100:00100000:3.0:1789042867.365853:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a472e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+9:5580:x1875947242390656:12345-192.168.203.17@tcp:101: Request processed in 194us (5762us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042867.365860:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 122 00000100:00100000:3.0:1789042867.369025:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042867.371057:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242390784 00000100:00100000:0.0:1789042867.371081:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242390784 00000100:00100000:0.0:1789042867.371174:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 123 00000100:00100000:0.0:1789042867.371196:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a472e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+9:5580:x1875947242390784:12345-192.168.203.17@tcp:256: 20000000:01000000:0.0:1789042867.371231:0:5839:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789042867.371263:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789042867.371267:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789042867.371277:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789042867.371279:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1789042867.375194:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a472e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+9:5580:x1875947242390784:12345-192.168.203.17@tcp:256: Request processed in 3975us (6160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042867.375212:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 123 00000100:00100000:0.0:1789042867.400475:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042867.400650:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242390912 00000100:00100000:3.0:1789042867.400664:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242390912 00000100:00100000:3.0:1789042867.400731:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 124 00000100:00100000:3.0:1789042867.400742:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46e5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+9:5580:x1875947242390912:12345-192.168.203.17@tcp:101: 00010000:00010000:3.0:1789042867.400775:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789042867.400797:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c05e8a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca6767f6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042867.400836:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c05e8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6767f6 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042867.400849:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c05e8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6767f6 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042867.400861:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc29e00, rc 0) 00000100:00100000:3.0:1789042867.400961:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46e5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:5580:x1875947242390912:12345-192.168.203.17@tcp:101: Request processed in 221us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042867.400969:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 124 00000100:00100000:0.0:1789042867.413085:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042867.414771:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242391040 00000100:00100000:3.0:1789042867.414791:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242391040 00000100:00100000:3.0:1789042867.414862:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 125 00000100:00100000:3.0:1789042867.414874:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46e5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:5580:x1875947242391040:12345-192.168.203.17@tcp:501: 00000100:00100000:3.0:1789042867.415362:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46e5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:5580:x1875947242391040:12345-192.168.203.17@tcp:501: Request processed in 480us (2282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042867.415372:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 125 00000100:00100000:2.0:1789042867.430677:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042867.431877:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242391168 00000100:00100000:3.0:1789042867.431905:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242391168 00000100:00100000:3.0:1789042867.431999:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 126 00000100:00100000:3.0:1789042867.432013:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46e5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:5580:x1875947242391168:12345-192.168.203.17@tcp:503: 00000100:00100000:3.0:1789042867.432559:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46e5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:5580:x1875947242391168:12345-192.168.203.17@tcp:503: Request processed in 547us (1896us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042867.432699:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 126 00000100:00100000:0.0:1789042867.452876:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042867.452928:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242391296 00000100:00100000:0.0:1789042867.452951:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242391296 00000100:00100000:0.0:1789042867.453013:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 127 00000100:00100000:0.0:1789042867.453023:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46e5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:5604:x1875947242391296:12345-192.168.203.17@tcp:502: 00000100:00100000:0.0:1789042867.463979:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46e5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:5604:x1875947242391296:12345-192.168.203.17@tcp:502: Request processed in 10939us (11099us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042867.463999:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 127 00000100:00100000:0.0:1789042867.468174:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042867.468236:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242391424 00000100:00100000:0.0:1789042867.468249:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242391424 00000100:00100000:0.0:1789042867.468320:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 128 00000100:00100000:0.0:1789042867.468333:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43887850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:5604:x1875947242391424:12345-192.168.203.17@tcp:502: 00000100:00100000:0.0:1789042867.468661:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43887850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:5604:x1875947242391424:12345-192.168.203.17@tcp:502: Request processed in 329us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042867.468671:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 128 00000100:00100000:2.0:1789042867.475677:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042867.475768:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242391552 00000100:00100000:3.0:1789042867.475781:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242391552 00000100:00100000:3.0:1789042867.475839:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 4 00000100:00100000:3.0:1789042867.475851:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75eded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2348:x1875947242391552:12345-192.168.203.17@tcp:38: 00010000:00080000:3.0:1789042867.475891:0:5847:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 3fb32839-ebfd-4c0f-90e4-f036c86704df@192.168.203.17@tcp t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:3.0:1789042867.475963:0:5847:0:(genops.c:1393:class_connect()) connect: client 3fb32839-ebfd-4c0f-90e4-f036c86704df, cookie 0x99260d7389c05e91 00000004:00100000:3.0:1789042867.475999:0:5847:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1789042867.476007:0:5847:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:3.0:1789042867.573541:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789042867.600587:0:5847:0:(import.c:65:import_set_state_nolock()) ffffa06a7656f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789042867.600694:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75eded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2348:x1875947242391552:12345-192.168.203.17@tcp:38: Request processed in 124842us (125029us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042867.601585:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 4 00000100:00100000:1.0:1789042868.466833:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52463100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875947267580800:0@lo:400: 00000100:00100000:0.0:1789042868.466851:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267581056:0@lo:400: 00000100:00100000:0.0:1789042868.466925:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042868.466993:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042868.467011:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789042868.467020:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875947267580928:0@lo:400: 00000100:00100000:0.0:1789042868.467067:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042868.467086:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267581312:0@lo:400: 00000100:00100000:1.0:1789042868.467116:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042868.467129:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267580800 00000100:00100000:0.0:1789042868.467140:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267580800 00000100:00100000:1.0:1789042868.467151:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789042868.467160:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267580672:0@lo:400: 00000100:00100000:2.0:1789042868.467185:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267581056 00000100:00100000:2.0:1789042868.467191:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267581056 00000100:00100000:1.0:1789042868.467197:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042868.467221:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267580928 00000100:00100000:0.0:1789042868.467225:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267580928 00000100:00100000:1.0:1789042868.467231:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875947267581184:0@lo:400: 00000100:00100000:2.0:1789042868.467257:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267581312 00000100:00100000:0.0:1789042868.467258:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789042868.467260:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042868.467261:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267581312 00000100:00100000:0.0:1789042868.467270:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875947267580800:12345-0@lo:400: 00000100:00100000:1.0:1789042868.467295:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789042868.467306:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267581056:12345-0@lo:400: 00000100:00100000:0.0:1789042868.467339:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875947267580800:12345-0@lo:400: Request processed in 71us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042868.467348:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789042868.467368:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267581056:12345-0@lo:400: Request processed in 63us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042868.467372:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267581184 00000100:00100000:0.0:1789042868.467377:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267581184 00000100:00100000:0.0:1789042868.467401:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789042868.467408:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875947267580928:12345-0@lo:400: 00000100:00100000:0.0:1789042868.467438:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875947267580928:12345-0@lo:400: Request processed in 30us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042868.467444:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789042868.467455:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789042868.467462:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875947267581184:12345-0@lo:400: 00000100:00100000:0.0:1789042868.467487:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875947267581184:12345-0@lo:400: Request processed in 25us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042868.467493:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789042868.467551:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267580672 00000100:00100000:0.0:1789042868.467554:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267580672 00000100:00100000:0.0:1789042868.467578:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789042868.467584:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43886450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267580672:12345-0@lo:400: 00000100:00100000:0.0:1789042868.467610:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43886450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267580672:12345-0@lo:400: Request processed in 26us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042868.467616:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789042868.467662:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267580672:0@lo:400: 00010000:00080000:0.0:1789042868.467687:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a52462a00 x1875947267581184/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789042884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042868.467698:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875947267581184:0@lo:400: 00010000:00080000:0.0:1789042868.467707:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a52463100 x1875947267580800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789042884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042868.467716:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52463100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875947267580800:0@lo:400: 00000100:00080000:0.0:1789042868.467761:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789042868.467765:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789042868.467767:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789042868.467784:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a52463b80 x1875947267580928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789042884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042868.467793:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875947267580928:0@lo:400: 00010000:00080000:0.0:1789042868.467802:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a52461500 x1875947267581056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042868.467810:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267581056:0@lo:400: 00000100:00100000:3.0:1789042868.468938:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789042868.468959:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789042868.472095:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789042868.472134:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267581312:12345-0@lo:400: 00000100:00100000:2.0:1789042868.472475:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267581312:12345-0@lo:400: Request processed in 363us (5357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042868.472485:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789042868.472710:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a52460000 x1875947267581312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042868.472725:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789042868.472749:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267581312:0@lo:400: 00000100:00100000:1.0:1789042868.474778:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1789042868.594851:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789042868.607234:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042868.608866:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042868.609100:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242391680 00000100:00100000:3.0:1789042868.609115:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242391680 00000100:00100000:3.0:1789042868.609198:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242391808 00000100:00100000:3.0:1789042868.609202:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242391808 00000100:00100000:3.0:1789042868.609225:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 5 00000100:00100000:3.0:1789042868.609236:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:0:x1875947242391680:12345-192.168.203.17@tcp:41: 00000004:00000024:3.0:1789042868.609300:0:6714:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789042868.609381:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:0:x1875947242391680:12345-192.168.203.17@tcp:41: Request processed in 146us (2163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042868.609993:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 5 00000100:00100000:1.0:1789042868.614716:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 6 00000100:00100000:1.0:1789042868.614760:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:5580:x1875947242391808:12345-192.168.203.17@tcp:41: 00000004:00000024:1.0:1789042868.614812:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789042868.614937:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:5580:x1875947242391808:12345-192.168.203.17@tcp:41: Request processed in 193us (6072us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042868.614947:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 6 00000100:00080000:1.0:1789042868.615044:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789042868.626135:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042868.626574:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242391936 00000100:00100000:1.0:1789042868.626589:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242391936 00000100:00100000:1.0:1789042868.627069:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 7 00000100:00100000:1.0:1789042868.627083:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:5580:x1875947242391936:12345-192.168.203.17@tcp:40: 00000100:00100000:1.0:1789042868.627209:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:5580:x1875947242391936:12345-192.168.203.17@tcp:40: Request processed in 129us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042868.627217:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 7 00000100:00100000:2.0:1789042868.635643:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042868.635709:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042868.636224:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242392320 00000100:00100000:3.0:1789042868.636237:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242392320 00000100:00100000:3.0:1789042868.636315:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 0 00000100:00100000:3.0:1789042868.636327:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75ede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:5580:x1875947242392320:12345-192.168.203.17@tcp:33: 00000100:00100000:0.0:1789042868.639115:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242392448 00000100:00100000:0.0:1789042868.639136:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242392448 00000100:00100000:0.0:1789042868.639249:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 130 00000100:00100000:0.0:1789042868.639262:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43886850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:2349:x1875947242392448:12345-192.168.203.17@tcp:400: 00000100:00100000:0.0:1789042868.639372:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43886850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:2349:x1875947242392448:12345-192.168.203.17@tcp:400: Request processed in 113us (3662us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042868.639381:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 130 00000100:00100000:3.0:1789042868.654011:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042868.654059:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042868.654697:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242392064 00000100:00100000:0.0:1789042868.654711:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242392064 00000100:00100000:0.0:1789042868.654764:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242392192 00000100:00100000:0.0:1789042868.654769:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242392192 00000100:00100000:0.0:1789042868.654795:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 8 00000100:00100000:0.0:1789042868.654806:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942104e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1875947242392064:12345-192.168.203.17@tcp:8: 00010000:00080000:0.0:1789042868.654846:0:6690:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3fb32839-ebfd-4c0f-90e4-f036c86704df@192.168.203.17@tcp t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:0.0:1789042868.654885:0:6690:0:(genops.c:1393:class_connect()) connect: client 3fb32839-ebfd-4c0f-90e4-f036c86704df, cookie 0x99260d7389c05e98 00002000:00100000:0.0:1789042868.654901:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3fb32839-ebfd-4c0f-90e4-f036c86704df/ffffa06a52b61800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789042868.654938:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789042868.655350:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789042868.655390:0:6690:0:(import.c:65:import_set_state_nolock()) ffffa06a52b63000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789042868.655485:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942104e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2348:x1875947242392064:12345-192.168.203.17@tcp:8: Request processed in 679us (1488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042868.655494:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 8 00000100:00100000:0.0:1789042868.655548:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 9 00000100:00100000:0.0:1789042868.655555:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942107100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1875947242392192:12345-192.168.203.17@tcp:8: 00010000:00080000:0.0:1789042868.655575:0:6690:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3fb32839-ebfd-4c0f-90e4-f036c86704df@192.168.203.17@tcp t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:0.0:1789042868.655595:0:6690:0:(genops.c:1393:class_connect()) connect: client 3fb32839-ebfd-4c0f-90e4-f036c86704df, cookie 0x99260d7389c05e9f 00002000:00100000:0.0:1789042868.655602:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3fb32839-ebfd-4c0f-90e4-f036c86704df/ffffa06a52b65800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789042868.655636:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789042868.655885:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789042868.655908:0:6690:0:(import.c:65:import_set_state_nolock()) ffffa06a7ab50800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789042868.655949:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942107100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2348:x1875947242392192:12345-192.168.203.17@tcp:8: Request processed in 393us (1888us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042868.655956:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 9 00000004:00080000:3.0:1789042868.691029:0:5848:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 54603us 00000004:00200000:3.0:1789042868.768658:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789042868.768799:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75ede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:5580:x1875947242392320:12345-192.168.203.17@tcp:33: Request processed in 132466us (133162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042868.768810:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 0 00000100:00100000:1.0:1789042868.978799:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789042868.978834:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52463100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267581440:0@lo:13: 00000100:00100000:1.0:1789042868.978951:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042868.979114:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267581440 00000100:00100000:0.0:1789042868.979124:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267581440 00000100:00100000:0.0:1789042868.979188:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789042868.979200:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267581440:12345-0@lo:13: 00002000:00000024:0.0:1789042868.979229:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789042868.979305:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267581440:12345-0@lo:13: Request processed in 106us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042868.979314:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1789042868.983465:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a52463100 x1875947267581440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042868.983502:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52463100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267581440:0@lo:13: 00000100:00100000:3.0:1789042869.153202:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042869.153327:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242392576 00000100:00100000:0.0:1789042869.153341:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242392576 00000100:00100000:0.0:1789042869.153416:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 8 00000100:00100000:0.0:1789042869.153429:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942107b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:5621:x1875947242392576:12345-192.168.203.17@tcp:101: 00010000:00010000:0.0:1789042869.153467:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789042869.159063:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c05ea6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676820 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042869.159144:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c05ead lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042869.159158:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c05ead lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042869.159193:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c05ead lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789042869.159231:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789042869.159234:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789042869.159251:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c05ead lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042869.159279:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c05ea6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676820 expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042869.159299:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c05ead lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676820 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042869.159307:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a55221d00) 00010000:00010000:0.0:1789042869.159310:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789042869.159313:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a40031600, rc 0) 00000100:00100000:0.0:1789042869.159395:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942107b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:5621:x1875947242392576:12345-192.168.203.17@tcp:101: Request processed in 5967us (6206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042869.159405:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 8 00010000:00010000:3.0:1789042869.618838:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789042870.109817:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3fb32839-ebfd-4c0f-90e4-f036c86704df 00000100:00100000:2.0:1789042870.514833:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267581568:0@lo:13: 00000100:00100000:2.0:1789042870.514946:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042870.519401:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267581568 00000100:00100000:0.0:1789042870.519426:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267581568 00000100:00080000:1.0:1789042870.519495:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789042870.520322:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789042870.520343:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75edc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267581568:12345-0@lo:13: 00002000:00000024:0.0:1789042870.520397:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789042870.520620:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75edc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267581568:12345-0@lo:13: Request processed in 286us (5674us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042870.520651:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1789042870.523188:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a52462a00 x1875947267581568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042886 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789042870.523228:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267581568:0@lo:13: 00010000:00010000:1.0:1789042870.642723:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789042871.574749:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042871.574871:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242392704 00000100:00100000:1.0:1789042871.574884:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242392704 00000100:00100000:1.0:1789042871.574993:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 9 00000100:00100000:1.0:1789042871.575013:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75edc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:5673:x1875947242392704:12345-192.168.203.17@tcp:41: 00000100:00080000:3.0:1789042871.575289:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:1.0:1789042871.575373:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789042871.575465:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75edc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:5673:x1875947242392704:12345-192.168.203.17@tcp:41: Request processed in 460us (3086us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042871.575473:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 9 00000100:00100000:2.0:1789042871.584251:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042871.584764:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242392832 00000100:00100000:0.0:1789042871.585144:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242392832 00000100:00100000:0.0:1789042871.585310:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 12 00000100:00100000:0.0:1789042871.585324:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:5673:x1875947242392832:12345-192.168.203.17@tcp:13: 00002000:00000024:0.0:1789042871.585362:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789042871.585485:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:5673:x1875947242392832:12345-192.168.203.17@tcp:13: Request processed in 163us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042871.585493:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 12 00000100:00080000:3.0:1789042871.595157:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789042871.603771:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042871.604300:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242392960 00000100:00100000:0.0:1789042871.604314:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242392960 00000100:00080000:1.0:1789042871.604549:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789042871.604678:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 13 00000100:00100000:0.0:1789042871.604693:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942105500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:5673:x1875947242392960:12345-192.168.203.17@tcp:13: 00002000:00000024:0.0:1789042871.604747:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789042871.604838:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942105500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:5673:x1875947242392960:12345-192.168.203.17@tcp:13: Request processed in 145us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042871.604847:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 13 00010000:00010000:3.0:1789042871.671423:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789042872.624327:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3fb32839-ebfd-4c0f-90e4-f036c86704df 00010000:00010000:1.0:1789042872.697435:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789042873.148720:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3fb32839-ebfd-4c0f-90e4-f036c86704df 00000100:00100000:0.0:1789042873.588371:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875947267581824:0@lo:400: 00000100:00100000:0.0:1789042873.588471:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042873.588558:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267582336:0@lo:400: 00000100:00100000:0.0:1789042873.588588:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042873.588634:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789042873.588641:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267581696:0@lo:400: 00000100:00100000:0.0:1789042873.588673:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042873.588696:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875947267582208:0@lo:400: 00000100:00100000:0.0:1789042873.588735:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042873.588766:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267581952:0@lo:400: 00000100:00100000:0.0:1789042873.588789:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042873.588807:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789042873.588812:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267582080:0@lo:400: 00000100:00100000:0.0:1789042873.588834:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042873.588862:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267581824 00000100:00100000:0.0:1789042873.588872:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267581824 00000100:00100000:0.0:1789042873.589039:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267582208 00000100:00100000:0.0:1789042873.589043:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267582208 00000100:00100000:0.0:1789042873.589063:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267581952 00000100:00100000:0.0:1789042873.589065:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267581952 00000100:00100000:0.0:1789042873.589083:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789042873.589093:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875947267581824:12345-0@lo:400: 00000100:00100000:0.0:1789042873.589159:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875947267581824:12345-0@lo:400: Request processed in 66us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042873.589166:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789042873.589185:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789042873.589191:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a520c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875947267582208:12345-0@lo:400: 00000100:00100000:0.0:1789042873.589219:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a520c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875947267582208:12345-0@lo:400: Request processed in 29us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042873.589226:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789042873.589239:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789042873.589245:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a520c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267581952:12345-0@lo:400: 00000100:00100000:0.0:1789042873.589274:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a520c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267581952:12345-0@lo:400: Request processed in 29us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042873.589279:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789042873.589313:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267582336 00000100:00100000:0.0:1789042873.589317:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267582336 00000100:00100000:0.0:1789042873.589347:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267582080 00000100:00100000:0.0:1789042873.589349:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267582080 00000100:00100000:0.0:1789042873.589608:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789042873.589616:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267582336:12345-0@lo:400: 00000100:00100000:0.0:1789042873.589655:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267582336:12345-0@lo:400: Request processed in 39us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042873.589661:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789042873.589673:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789042873.589680:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a520c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267582080:12345-0@lo:400: 00000100:00100000:0.0:1789042873.589706:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a520c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267582080:12345-0@lo:400: Request processed in 28us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042873.589713:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1789042873.589755:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a52460a80 x1875947267582080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042873.589773:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267582080:0@lo:400: 00000100:00100000:0.0:1789042873.589790:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267581952:0@lo:400: 00000100:00100000:0.0:1789042873.589825:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875947267582208:0@lo:400: 00000100:00100000:0.0:1789042873.589835:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875947267581824:0@lo:400: 00010000:00080000:0.0:1789042873.589845:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a52462d80 x1875947267582336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042873.589853:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267582336:0@lo:400: 00000100:00080000:1.0:1789042873.590083:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789042873.590089:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789042873.590092:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789042873.590985:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267581696 00000100:00100000:3.0:1789042873.590998:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267581696 00000100:00100000:3.0:1789042873.591355:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789042873.591376:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43887050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267581696:12345-0@lo:400: 00000100:00100000:3.0:1789042873.591494:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43887050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267581696:12345-0@lo:400: Request processed in 128us (2817us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042873.591503:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789042873.591626:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267581696:0@lo:400: 00010000:00010000:2.0:1789042873.721057:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789042874.074062:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042874.074123:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042874.074173:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042874.074203:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042874.074240:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242393088 00000100:00100000:3.0:1789042874.074253:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242393088 00000100:00100000:0.0:1789042874.074303:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242393344 00000100:00100000:0.0:1789042874.074319:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242393344 00000100:00100000:3.0:1789042874.074335:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 132 00000100:00100000:3.0:1789042874.074353:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:2349:x1875947242393088:12345-192.168.203.17@tcp:400: 00000100:00100000:0.0:1789042874.074401:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242393472 00000100:00100000:3.0:1789042874.074693:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:2349:x1875947242393088:12345-192.168.203.17@tcp:400: Request processed in 345us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042874.074702:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 132 00000100:00100000:3.0:1789042874.074747:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00100000:3.0:1789042874.074757:0:8215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942104000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2349:x1875947242393344:12345-192.168.203.17@tcp:400: 00000100:00100000:3.0:1789042874.074794:0:8215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942104000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2349:x1875947242393344:12345-192.168.203.17@tcp:400: Request processed in 38us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042874.074801:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00100000:2.0:1789042874.074824:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242393216 00000100:00100000:2.0:1789042874.074831:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242393216 00000100:00100000:2.0:1789042874.074906:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 30 00000100:00100000:2.0:1789042874.074920:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942106a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2350:x1875947242393216:12345-192.168.203.17@tcp:400: 00000100:00100000:2.0:1789042874.075008:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942106a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2350:x1875947242393216:12345-192.168.203.17@tcp:400: Request processed in 92us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042874.075015:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 30 00000100:00080000:2.0:1789042874.076021:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789042874.076027:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789042874.076182:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242393472 00000100:00100000:0.0:1789042874.076243:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00100000:0.0:1789042874.076251:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942106680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2350:x1875947242393472:12345-192.168.203.17@tcp:400: 00000100:00100000:0.0:1789042874.076303:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942106680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2350:x1875947242393472:12345-192.168.203.17@tcp:400: Request processed in 53us (2099us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042874.076310:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00080000:3.0:1789042874.078445:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789042874.100729:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789042874.100763:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06942105c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267582464:0@lo:13: 00000100:00100000:3.0:1789042874.100861:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042874.101001:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267582464 00000100:00100000:3.0:1789042874.101012:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267582464 00000100:00100000:3.0:1789042874.101090:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789042874.101101:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942105180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267582464:12345-0@lo:13: 00002000:00000024:3.0:1789042874.101162:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789042874.101215:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942105180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267582464:12345-0@lo:13: Request processed in 115us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042874.101223:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789042874.101292:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06942105c00 x1875947267582464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042890 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042874.101315:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06942105c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267582464:0@lo:13: 00000001:02000400:2.0:1789042874.605258:0:8302:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1789042874.741678:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789042875.653717:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267582592:0@lo:13: 00000100:00100000:3.0:1789042875.653821:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042875.654644:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267582592 00000100:00100000:0.0:1789042875.654660:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267582592 00000100:00100000:0.0:1789042875.654748:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789042875.654760:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942105c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267582592:12345-0@lo:13: 00002000:00000024:0.0:1789042875.654809:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789042875.654902:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942105c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267582592:12345-0@lo:13: Request processed in 144us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042875.654911:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1789042875.654979:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a52461880 x1875947267582592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042891 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042875.655005:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267582592:0@lo:13: 00000100:00080000:3.0:1789042875.655210:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789042875.765855:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789042876.796635:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789042877.813633:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789042878.711996:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06942107800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267582976:0@lo:400: 00000100:00100000:3.0:1789042878.712092:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042878.712180:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789042878.712188:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06942104700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267583104:0@lo:400: 00000100:00100000:3.0:1789042878.712242:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042878.712284:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06942104a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875947267582848:0@lo:400: 00000100:00100000:3.0:1789042878.712313:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042878.712349:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267583360:0@lo:400: 00000100:00100000:3.0:1789042878.712373:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042878.712396:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789042878.712401:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06942106d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267582720:0@lo:400: 00000100:00100000:3.0:1789042878.712442:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042878.712466:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06942106300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875947267583232:0@lo:400: 00000100:00100000:3.0:1789042878.712487:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042878.712543:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267583104 00000100:00100000:3.0:1789042878.712554:0:8215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267583104 00000100:00100000:3.0:1789042878.712979:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267583360 00000100:00100000:3.0:1789042878.712985:0:8215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267583360 00000100:00100000:3.0:1789042878.713019:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789042878.713042:0:8215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f835c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267583104:12345-0@lo:400: 00000100:00100000:3.0:1789042878.713122:0:8215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f835c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267583104:12345-0@lo:400: Request processed in 83us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042878.713130:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789042878.713148:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789042878.713155:0:8215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f836d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267583360:12345-0@lo:400: 00000100:00100000:3.0:1789042878.713189:0:8215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f836d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267583360:12345-0@lo:400: Request processed in 34us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042878.713195:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789042878.713220:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267582976 00000100:00100000:3.0:1789042878.713225:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267582976 00000100:00100000:3.0:1789042878.713252:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267582848 00000100:00100000:3.0:1789042878.713255:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267582848 00000100:00100000:3.0:1789042878.713266:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267583232 00000100:00100000:3.0:1789042878.713269:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267583232 00000100:00100000:3.0:1789042878.713283:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789042878.713289:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267582976:12345-0@lo:400: 00000100:00100000:3.0:1789042878.713320:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267582976:12345-0@lo:400: Request processed in 32us (1228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042878.713592:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789042878.713700:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789042878.713710:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875947267582848:12345-0@lo:400: 00000100:00100000:3.0:1789042878.713748:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875947267582848:12345-0@lo:400: Request processed in 41us (1434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042878.713754:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789042878.713767:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789042878.713773:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875947267583232:12345-0@lo:400: 00000100:00100000:3.0:1789042878.713816:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875947267583232:12345-0@lo:400: Request processed in 42us (1326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042878.713822:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789042878.715010:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267582720 00000100:00100000:3.0:1789042878.715025:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267582720 00000100:00100000:3.0:1789042878.715079:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789042878.715089:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43885850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267582720:12345-0@lo:400: 00000100:00100000:3.0:1789042878.715156:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43885850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267582720:12345-0@lo:400: Request processed in 69us (2712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042878.715446:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:3.0:1789042878.715509:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789042878.715538:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789042878.715542:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789042878.716877:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06942106d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267582720:0@lo:400: 00000100:00100000:3.0:1789042878.716908:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06942106300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875947267583232:0@lo:400: 00000100:00100000:3.0:1789042878.716926:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06942104a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875947267582848:0@lo:400: 00010000:00080000:3.0:1789042878.716946:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7a024700 x1875947267583360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042878.716958:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267583360:0@lo:400: 00010000:00080000:3.0:1789042878.717019:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06942104700 x1875947267583104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042878.717030:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06942104700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267583104:0@lo:400: 00000100:00100000:3.0:1789042878.717047:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06942107800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267582976:0@lo:400: 00010000:00010000:3.0:1789042878.835685:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789042879.184491:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042879.184554:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042879.184589:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042879.184612:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042879.184648:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242393600 00000100:00100000:3.0:1789042879.184660:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242393600 00000100:00100000:3.0:1789042879.184718:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 134 00000100:00100000:3.0:1789042879.184729:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:2352:x1875947242393600:12345-192.168.203.17@tcp:400: 00000100:00100000:3.0:1789042879.184811:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:2352:x1875947242393600:12345-192.168.203.17@tcp:400: Request processed in 85us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042879.184819:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 134 00000100:00100000:3.0:1789042879.184865:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242393984 00000100:00100000:3.0:1789042879.184869:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242393984 00000100:00100000:3.0:1789042879.184903:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242393856 00000100:00100000:3.0:1789042879.184906:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242393856 00000100:00100000:3.0:1789042879.184928:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 14 00000100:00100000:3.0:1789042879.184935:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f834700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2352:x1875947242393984:12345-192.168.203.17@tcp:400: 00000100:00100000:2.0:1789042879.184953:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 15 00000100:00100000:3.0:1789042879.184966:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f834700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2352:x1875947242393984:12345-192.168.203.17@tcp:400: Request processed in 30us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042879.184990:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 14 00000100:00100000:2.0:1789042879.184997:0:8215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2352:x1875947242393856:12345-192.168.203.17@tcp:400: 00000100:00100000:2.0:1789042879.185036:0:8215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2352:x1875947242393856:12345-192.168.203.17@tcp:400: Request processed in 55us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042879.185044:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 15 00000100:00080000:3.0:1789042879.185139:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789042879.185145:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789042879.187207:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242393728 00000100:00100000:1.0:1789042879.187240:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242393728 00000100:00100000:1.0:1789042879.187347:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 34 00000100:00100000:1.0:1789042879.187367:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2352:x1875947242393728:12345-192.168.203.17@tcp:400: 00000100:00100000:1.0:1789042879.187481:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2352:x1875947242393728:12345-192.168.203.17@tcp:400: Request processed in 123us (3003us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042879.187490:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 34 00000100:00080000:2.0:1789042879.187784:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789042879.221570:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267583488:0@lo:13: 00000100:00100000:1.0:1789042879.221699:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042879.224438:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267583488 00000100:00100000:3.0:1789042879.224462:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267583488 00000100:00100000:3.0:1789042879.224570:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789042879.224585:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5097d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267583488:12345-0@lo:13: 00002000:00000024:3.0:1789042879.224638:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789042879.224760:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5097d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267583488:12345-0@lo:13: Request processed in 178us (3061us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042879.224783:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1789042879.224843:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7f837480 x1875947267583488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042895 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042879.224883:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267583488:0@lo:13: 00000020:00000080:3.0:1789042879.402046:0:8452:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd7b7cb820 20000000:00000080:3.0:1789042879.402070:0:8452:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa06a77041000 uarg=0000000000000000 20000000:01000000:3.0:1789042879.402322:0:8452:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1789042879.402326:0:8452:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1789042879.402329:0:8452:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789042879.402334:0:8452:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789042879.402341:0:8452:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1789042879.402360:0:8452:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789042879.402363:0:8452:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789042879.403464:0:8452:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789042879.403471:0:8452:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789042879.406165:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1789042879.409084:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1789042879.410006:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1789042879.410065:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1789042879.411451:0:8452:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789042879.411462:0:8452:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789042879.413009:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1789042879.413621:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1789042879.413686:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1789042879.413726:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1789042879.413742:0:8452:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789042879.413745:0:8452:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789042879.415881:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1789042879.416555:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1789042879.416634:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1789042879.416671:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1789042879.416685:0:8452:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789042879.416688:0:8452:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789042879.427850:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1789042879.428464:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1789042879.428603:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1789042879.428664:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:2.0:1789042879.428687:0:8452:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789042879.428715:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa06a58604800/0x99260d7389c05eb4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042879.428895:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a40030600/0x99260d7389c05db1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05daa expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042879.428904:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a41687c00/0x99260d7389c05ddb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05dd4 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042879.428911:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a6fc28c00/0x99260d7389c05e05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05dfe expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042879.428918:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a41686800/0x99260d7389c05e13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05e0c expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042879.428925:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a58605c00/0x99260d7389c05e21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05e1a expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042879.428932:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a58605000/0x99260d7389c05e3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05e36 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042879.428939:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a40031a00/0x99260d7389c05e67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05e60 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042879.428950:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a6fc28800/0x99260d7389c05e75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6767be expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042879.428958:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a6fc28e00/0x99260d7389c05e7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6767c5 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042879.428966:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa06a58604800/0x99260d7389c05eb4 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042879.429031:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a6fc28e00/0x99260d7389c05e7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6767c5 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042879.429052:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa06a6fc28e00/0x99260d7389c05e7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6767c5 expref: 9 pid: 5841 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042879.429070:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75edce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875947267583616:192.168.203.17@tcp:104: 00010000:00010000:2.0:1789042879.429259:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a6fc28800/0x99260d7389c05e75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6767be expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042879.429270:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa06a6fc28800/0x99260d7389c05e75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6767be expref: 9 pid: 5840 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042879.429279:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75edf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875947267583744:192.168.203.17@tcp:104: 00010000:00010000:2.0:1789042879.429315:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a40031a00/0x99260d7389c05e67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99260d7389c05e60 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042879.429323:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa06a40031a00/0x99260d7389c05e67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99260d7389c05e60 expref: 18 pid: 5839 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042879.429332:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75eddf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875947267583872:0@lo:104: 00000100:00100000:2.0:1789042879.429380:0:8452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789042879.429421:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a58605000/0x99260d7389c05e3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99260d7389c05e36 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042879.429430:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa06a58605000/0x99260d7389c05e3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99260d7389c05e36 expref: 18 pid: 5839 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042879.429450:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75edf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875947267584000:0@lo:104: 00000100:00100000:2.0:1789042879.429480:0:8452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789042879.429550:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a58605c00/0x99260d7389c05e21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99260d7389c05e1a expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042879.429559:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa06a58605c00/0x99260d7389c05e21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99260d7389c05e1a expref: 18 pid: 5841 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042879.429568:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767da680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875947267584128:0@lo:104: 00010000:00010000:2.0:1789042879.429597:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a41686800/0x99260d7389c05e13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99260d7389c05e0c expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042879.429605:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa06a41686800/0x99260d7389c05e13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99260d7389c05e0c expref: 18 pid: 5841 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042879.429612:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767d9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875947267584256:0@lo:104: 00010000:00010000:2.0:1789042879.429640:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a6fc28c00/0x99260d7389c05e05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99260d7389c05dfe expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042879.429648:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa06a6fc28c00/0x99260d7389c05e05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99260d7389c05dfe expref: 18 pid: 5840 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042879.429656:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767d9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875947267584384:0@lo:104: 00010000:00010000:2.0:1789042879.429682:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a41687c00/0x99260d7389c05ddb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99260d7389c05dd4 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042879.429690:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa06a41687c00/0x99260d7389c05ddb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99260d7389c05dd4 expref: 18 pid: 5840 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042879.429711:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767dad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875947267584512:0@lo:104: 00000100:00100000:0.0:1789042879.430631:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789042879.430669:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042879.430690:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042879.430699:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042879.430709:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267583872 00000100:00100000:0.0:1789042879.430719:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267583872 00000100:00100000:0.0:1789042879.430776:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267584000 00000100:00100000:0.0:1789042879.430779:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267584000 00000100:00100000:0.0:1789042879.430804:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267584128 00000100:00100000:0.0:1789042879.430806:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267584128 00000100:00100000:0.0:1789042879.430814:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267584256 00000100:00100000:0.0:1789042879.430816:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267584256 00000100:00100000:0.0:1789042879.430823:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267584384 00000100:00100000:0.0:1789042879.430825:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267584384 00000100:00100000:0.0:1789042879.430837:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789042879.430846:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75edc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+7:8452:x1875947267583872:12345-0@lo:104: 00010000:00010000:0.0:1789042879.430877:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05e60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05e67 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.431075:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789042879.431082:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75edc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+7:8452:x1875947267583872:12345-0@lo:104: Request processed in 237us (1703us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042879.431090:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789042879.431113:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789042879.431118:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79efd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+6:8452:x1875947267584000:12345-0@lo:104: 00010000:00010000:0.0:1789042879.431127:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28a00/0x99260d7389c05e36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05e3d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.431164:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789042879.431169:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79efd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+6:8452:x1875947267584000:12345-0@lo:104: Request processed in 51us (1689us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042879.431175:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789042879.431212:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789042879.431218:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52461880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+5:8452:x1875947267584128:12345-0@lo:104: 00010000:00010000:0.0:1789042879.431226:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffffa06a58604200/0x99260d7389c05e1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05e21 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.431273:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789042879.431278:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52461880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+5:8452:x1875947267584128:12345-0@lo:104: Request processed in 60us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042879.431284:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789042879.431298:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789042879.431304:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52462d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+4:8452:x1875947267584256:12345-0@lo:104: 00010000:00010000:0.0:1789042879.431310:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffffa06a6fc29200/0x99260d7389c05e0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05e13 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.431336:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789042879.431340:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52462d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+4:8452:x1875947267584256:12345-0@lo:104: Request processed in 38us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042879.431346:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789042879.431356:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789042879.431361:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52461c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+3:8452:x1875947267584384:12345-0@lo:104: 00010000:00010000:0.0:1789042879.431368:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28200/0x99260d7389c05dfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05e05 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.431392:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1789042879.431397:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52461c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+3:8452:x1875947267584384:12345-0@lo:104: Request processed in 36us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042879.431402:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1789042879.431428:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789042879.431434:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05e60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05e67 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.431442:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a40031e00 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:0.0:1789042879.431453:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05e60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x99260d7389c05e67 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.431463:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05e60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x99260d7389c05e67 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789042879.431470:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05e60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x99260d7389c05e67 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789042879.431477:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789042879.431554:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05e60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05e67 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.431561:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789042879.431585:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05e60 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05e67 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.431593:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05e60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05e67 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.431610:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789042879.431614:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28a00/0x99260d7389c05e36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05e3d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.431619:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc28a00 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:0.0:1789042879.431622:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28a00/0x99260d7389c05e36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x99260d7389c05e3d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.431629:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28a00/0x99260d7389c05e36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x99260d7389c05e3d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789042879.431646:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28a00/0x99260d7389c05e36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x99260d7389c05e3d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789042879.431651:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789042879.431665:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28a00/0x99260d7389c05e36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05e3d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.431671:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789042879.431688:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28a00/0x99260d7389c05e36 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05e3d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.431696:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28a00/0x99260d7389c05e36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05e3d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.431707:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789042879.431709:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a58604200/0x99260d7389c05e1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05e21 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.431715:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a58604200 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:0.0:1789042879.431717:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a58604200/0x99260d7389c05e1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x99260d7389c05e21 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042879.432158:0:8452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789042879.432217:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a40030600/0x99260d7389c05db1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99260d7389c05daa expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042879.432232:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa06a40030600/0x99260d7389c05db1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99260d7389c05daa expref: 18 pid: 5841 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042879.432247:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767db800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875947267584896:0@lo:104: 00000100:00100000:2.0:1789042879.432281:0:8452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042879.432301:0:8452:0:(client.c:2716:ptlrpc_set_wait()) set ffffa069411ef6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789042879.432329:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75eddf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875947267583872:0@lo:104: 00000100:00100000:2.0:1789042879.432339:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75edf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875947267584000:0@lo:104: 00000100:00100000:2.0:1789042879.432347:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767da680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875947267584128:0@lo:104: 00000100:00100000:2.0:1789042879.432355:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767d9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875947267584256:0@lo:104: 00000100:00100000:2.0:1789042879.432363:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767d9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875947267584384:0@lo:104: 00010000:00010000:0.0:1789042879.437244:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a58604200/0x99260d7389c05e1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x99260d7389c05e21 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789042879.437272:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a58604200/0x99260d7389c05e1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x99260d7389c05e21 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789042879.437280:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789042879.437363:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a58604200/0x99260d7389c05e1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05e21 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.437370:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789042879.437390:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a58604200/0x99260d7389c05e1a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05e21 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.437400:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a58604200/0x99260d7389c05e1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05e21 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.437422:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789042879.437428:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a6fc29200/0x99260d7389c05e0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05e13 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.437434:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc29200 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:0.0:1789042879.437437:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a6fc29200/0x99260d7389c05e0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x99260d7389c05e13 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.437444:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a6fc29200/0x99260d7389c05e0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x99260d7389c05e13 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789042879.437450:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a6fc29200/0x99260d7389c05e0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x99260d7389c05e13 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789042879.437456:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789042879.437474:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a6fc29200/0x99260d7389c05e0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05e13 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.437480:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789042879.437489:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a6fc29200/0x99260d7389c05e0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05e13 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042879.437495:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00010000:00010000:0.0:1789042879.437536:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a6fc29200/0x99260d7389c05e0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05e13 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.437549:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789042879.437553:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28200/0x99260d7389c05dfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05e05 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042879.437562:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00010000:00010000:0.0:1789042879.437567:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc28200 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:0.0:1789042879.437572:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28200/0x99260d7389c05dfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x99260d7389c05e05 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.437580:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28200/0x99260d7389c05dfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x99260d7389c05e05 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789042879.437586:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28200/0x99260d7389c05dfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x99260d7389c05e05 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789042879.437591:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789042879.437605:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242394240 00010000:00010000:0.0:1789042879.437609:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28200/0x99260d7389c05dfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05e05 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042879.437615:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242394240 00010000:00010000:0.0:1789042879.437617:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789042879.437624:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28200/0x99260d7389c05dfe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05e05 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.437631:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28200/0x99260d7389c05dfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05e05 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.437642:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789042879.437650:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789042879.437652:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789042879.437660:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a6fc28800/0x99260d7389c05e75 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6767be expref: 10 pid: 5840 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.437662:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789042879.437688:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3315:1875947267584640:0@lo:103: 00000100:00100000:3.0:1789042879.437699:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242394112 00000100:00100000:3.0:1789042879.437704:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242394112 00010000:00010000:3.0:1789042879.437719:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a6fc28e00/0x99260d7389c05e7c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6767c5 expref: 11 pid: 5841 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042879.437743:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 12 00000100:00100000:3.0:1789042879.437757:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f834380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+11:2352:x1875947242394240:12345-192.168.203.17@tcp:103: 00000100:00100000:0.0:1789042879.437773:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789042879.437775:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789042879.437784:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a6fc28800/0x99260d7389c05e75 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6767be expref: 11 pid: 5840 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042879.437815:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3315:1875947267585280:0@lo:103: 00010000:00010000:3.0:1789042879.437823:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a6fc28800/0x99260d7389c05e75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6767be expref: 11 pid: 5840 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042879.437840:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789042879.437849:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789042879.437868:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789042879.437876:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3315:1875947267585152:0@lo:103: 00000100:00100000:0.0:1789042879.437902:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042879.437927:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f834380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+11:2352:x1875947242394240:12345-192.168.203.17@tcp:103: Request processed in 172us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042879.437936:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 12 00000100:00100000:3.0:1789042879.437954:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267584640 00000100:00100000:3.0:1789042879.437958:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267584640 00010000:00010000:3.0:1789042879.437970:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a40031a00/0x99260d7389c05e67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05e60 expref: 19 pid: 5839 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042879.437981:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267585280 00000100:00100000:3.0:1789042879.437984:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267585280 00010000:00010000:3.0:1789042879.437994:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a6fc28c00/0x99260d7389c05e05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05dfe expref: 20 pid: 5840 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042879.438004:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267585152 00000100:00100000:3.0:1789042879.438006:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267585152 00010000:00010000:3.0:1789042879.438015:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a41686800/0x99260d7389c05e13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05e0c expref: 21 pid: 5841 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042879.438026:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 13 00000100:00100000:3.0:1789042879.438032:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f835f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:2352:x1875947242394112:12345-192.168.203.17@tcp:103: 00010000:00010000:3.0:1789042879.438057:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789042879.438063:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a6fc28e00/0x99260d7389c05e7c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6767c5 expref: 10 pid: 5841 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042879.438073:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a6fc28e00/0x99260d7389c05e7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6767c5 expref: 10 pid: 5841 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042879.438090:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789042879.438190:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f835f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:2352:x1875947242394112:12345-192.168.203.17@tcp:103: Request processed in 156us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042879.438196:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 13 00000100:00100000:3.0:1789042879.438210:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789042879.438216:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+21:3315:x1875947267584640:12345-0@lo:103: 00010000:00010000:3.0:1789042879.438224:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789042879.438229:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a40031a00/0x99260d7389c05e67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05e60 expref: 21 pid: 5839 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042879.438238:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a40031a00/0x99260d7389c05e67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99260d7389c05e60 expref: 21 pid: 5839 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042879.438250:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a40031a00/0x99260d7389c05e67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99260d7389c05e60 expref: 21 pid: 5839 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042879.438260:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789042879.438288:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+20:3315:x1875947267584640:12345-0@lo:103: Request processed in 71us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042879.438294:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789042879.438306:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789042879.438312:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3315:x1875947267585280:12345-0@lo:103: 00010000:00010000:3.0:1789042879.438319:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789042879.438323:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a6fc28c00/0x99260d7389c05e05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05dfe expref: 19 pid: 5840 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042879.438332:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a6fc28c00/0x99260d7389c05e05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99260d7389c05dfe expref: 19 pid: 5840 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042879.438349:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a6fc28c00/0x99260d7389c05e05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99260d7389c05dfe expref: 19 pid: 5840 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042879.438358:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789042879.438381:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:3315:x1875947267585280:12345-0@lo:103: Request processed in 70us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042879.438387:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789042879.438401:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789042879.438407:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a520c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:3315:x1875947267585152:12345-0@lo:103: 00010000:00010000:3.0:1789042879.438414:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789042879.438419:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a41686800/0x99260d7389c05e13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05e0c expref: 17 pid: 5841 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042879.438427:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a41686800/0x99260d7389c05e13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99260d7389c05e0c expref: 17 pid: 5841 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042879.438437:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a41686800/0x99260d7389c05e13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99260d7389c05e0c expref: 17 pid: 5841 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042879.438446:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789042879.438467:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a520c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:3315:x1875947267585152:12345-0@lo:103: Request processed in 60us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042879.438473:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1789042879.438714:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a6fc28e00/0x99260d7389c05e7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6767c5 expref: 9 pid: 5841 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042879.438726:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75edce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875947267583616:192.168.203.17@tcp:104: 00010000:00010000:2.0:1789042879.438739:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a6fc28800/0x99260d7389c05e75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6767be expref: 8 pid: 5840 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042879.438747:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75edf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875947267583744:192.168.203.17@tcp:104: 00000100:00100000:0.0:1789042879.440640:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267584768:0@lo:103: 00000100:00100000:0.0:1789042879.440802:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042879.440889:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789042879.440899:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267585024:0@lo:103: 00000100:00100000:3.0:1789042879.440909:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267584768 00000100:00100000:3.0:1789042879.440923:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267584768 00010000:00010000:3.0:1789042879.440974:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a58605000/0x99260d7389c05e3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05e36 expref: 16 pid: 5839 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042879.441005:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042879.441011:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789042879.441040:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75edc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:3312:x1875947267584768:12345-0@lo:103: 00000100:00100000:0.0:1789042879.441043:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267585024 00000100:00100000:0.0:1789042879.441049:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267585024 00010000:00010000:3.0:1789042879.441061:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789042879.441070:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a58605000/0x99260d7389c05e3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05e36 expref: 17 pid: 5839 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.441072:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a58605c00/0x99260d7389c05e21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05e1a expref: 17 pid: 5841 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042879.441103:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789042879.441110:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a55f66050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:3312:x1875947267585024:12345-0@lo:103: 00010000:00010000:0.0:1789042879.441119:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789042879.441123:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a58605c00/0x99260d7389c05e21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05e1a expref: 17 pid: 5841 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042879.441171:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a58605000/0x99260d7389c05e3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99260d7389c05e36 expref: 17 pid: 5839 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.441460:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a58605c00/0x99260d7389c05e21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99260d7389c05e1a expref: 17 pid: 5841 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.441495:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a58605c00/0x99260d7389c05e21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99260d7389c05e1a expref: 17 pid: 5841 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.441545:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789042879.441595:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a55f66050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:3312:x1875947267585024:12345-0@lo:103: Request processed in 485us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042879.441603:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789042879.441643:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267584512 00000100:00100000:0.0:1789042879.441649:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267584512 00000100:00100000:0.0:1789042879.441668:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267584896 00000100:00100000:0.0:1789042879.441671:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267584896 00000100:00100000:0.0:1789042879.441683:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789042879.441690:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+4:8452:x1875947267584512:12345-0@lo:104: 00010000:00010000:0.0:1789042879.441706:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffffa06a41686600/0x99260d7389c05dd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05ddb expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042879.442338:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267585024:0@lo:103: 00010000:00010000:0.0:1789042879.442454:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789042879.442462:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+4:8452:x1875947267584512:12345-0@lo:104: Request processed in 772us (10306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042879.442471:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789042879.442492:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789042879.442500:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+3:8452:x1875947267584896:12345-0@lo:104: 00010000:00010000:0.0:1789042879.442534:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c05daa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05db1 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.442577:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789042879.442582:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+3:8452:x1875947267584896:12345-0@lo:104: Request processed in 84us (10301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042879.442600:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1789042879.442619:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789042879.442626:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a41686600/0x99260d7389c05dd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05ddb expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.442634:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686600 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:0.0:1789042879.442639:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a41686600/0x99260d7389c05dd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x99260d7389c05ddb expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.442649:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a41686600/0x99260d7389c05dd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x99260d7389c05ddb expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789042879.442657:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a41686600/0x99260d7389c05dd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x99260d7389c05ddb expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789042879.442663:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789042879.442718:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a41686600/0x99260d7389c05dd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05ddb expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042879.443076:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767dad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875947267584512:0@lo:104: 00000100:00100000:1.0:1789042879.443089:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767db800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875947267584896:0@lo:104: 00010000:00010000:1.0:1789042879.443137:0:8452:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa06a58604800/0x99260d7389c05eb4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042879.443601:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3315:1875947267585152:0@lo:103: 00000100:00100000:1.0:1789042879.443614:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3315:1875947267584640:0@lo:103: 00000100:00100000:1.0:1789042879.443622:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3315:1875947267585280:0@lo:103: 00010000:00010000:0.0:1789042879.443826:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789042879.443885:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267585408:0@lo:103: 00000100:00100000:1.0:1789042879.443957:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789042879.444040:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a41686600/0x99260d7389c05dd4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05ddb expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.444049:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a41686600/0x99260d7389c05dd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05ddb expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.444070:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789042879.444074:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c05daa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05db1 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.444093:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a58604400 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:0.0:1789042879.444098:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c05daa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x99260d7389c05db1 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.444108:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c05daa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x99260d7389c05db1 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789042879.444117:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c05daa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x99260d7389c05db1 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789042879.444123:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789042879.444157:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c05daa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05db1 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.444163:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789042879.444468:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a58605000/0x99260d7389c05e3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99260d7389c05e36 expref: 15 pid: 5839 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042879.444488:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789042879.452070:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c05daa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05db1 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.452093:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c05daa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05db1 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.452128:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789042879.452130:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789042879.452133:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789042879.452181:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267585536:0@lo:103: 00000100:00100000:0.0:1789042879.452302:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042879.452403:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267585408 00000100:00100000:0.0:1789042879.452413:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267585408 00010000:00010000:0.0:1789042879.452454:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a41687c00/0x99260d7389c05ddb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05dd4 expref: 15 pid: 5840 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042879.452495:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267585536 00000100:00100000:0.0:1789042879.452509:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789042879.452510:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267585536 00000100:00100000:0.0:1789042879.452546:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5097ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:3312:x1875947267585408:12345-0@lo:103: 00010000:00010000:2.0:1789042879.452566:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a40030600/0x99260d7389c05db1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05daa expref: 16 pid: 5841 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.452567:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789042879.452576:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a41687c00/0x99260d7389c05ddb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05dd4 expref: 16 pid: 5840 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042879.452588:0:5833:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00010000:00010000:0.0:1789042879.452593:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a41687c00/0x99260d7389c05ddb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99260d7389c05dd4 expref: 16 pid: 5840 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042879.452598:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:0.0:1789042879.452617:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a41687c00/0x99260d7389c05ddb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99260d7389c05dd4 expref: 16 pid: 5840 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.452632:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789042879.452668:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5097ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:3312:x1875947267585408:12345-0@lo:103: Request processed in 127us (8712us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042879.452675:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789042879.452692:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789042879.452697:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+14:3313:x1875947267585536:12345-0@lo:103: 00010000:00010000:0.0:1789042879.452704:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789042879.452708:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a40030600/0x99260d7389c05db1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05daa expref: 14 pid: 5841 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.452716:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a40030600/0x99260d7389c05db1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99260d7389c05daa expref: 14 pid: 5841 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.452739:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a40030600/0x99260d7389c05db1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99260d7389c05daa expref: 14 pid: 5841 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.452763:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa06a58604800/0x99260d7389c05eb4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.452773:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a58604800/0x99260d7389c05eb4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.452788:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa06a58604800/0x99260d7389c05eb4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.452797:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa06a58604800/0x99260d7389c05eb4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.452805:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa06a58604800/0x99260d7389c05eb4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.452811:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa06a58604800/0x99260d7389c05eb4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.452818:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a58604800 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789042879.452824:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa06a58604800/0x99260d7389c05eb4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.452833:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa06a58604800/0x99260d7389c05eb4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.452864:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa06a58604800/0x99260d7389c05eb4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042879.452876:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789042879.452891:0:8452:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa06a58604800/0x99260d7389c05eb4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042879.452904:0:8452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa06a58604800/0x99260d7389c05eb4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042879.452910:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:3313:x1875947267585536:12345-0@lo:103: Request processed in 210us (606us total) trans 0 rc 0/0 00010000:00010000:2.0:1789042879.452915:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a58604800/0x99260d7389c05eb4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042879.452940:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789042879.453113:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267585536:0@lo:103: 00010000:00010000:0.0:1789042879.453140:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789042879.457978:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75edc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:3312:x1875947267584768:12345-0@lo:103: Request processed in 16924us (17160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042879.457997:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789042879.459072:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267584768:0@lo:103: 00000100:00100000:1.0:1789042879.459113:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267585408:0@lo:103: 00010000:00010000:0.0:1789042879.858832:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789042880.755273:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267585664:0@lo:13: 00000100:00100000:1.0:1789042880.755376:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042880.756947:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267585664 00000100:00100000:3.0:1789042880.756964:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267585664 00000100:00100000:3.0:1789042880.757059:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789042880.757071:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5097c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267585664:12345-0@lo:13: 00000100:00080000:2.0:1789042880.757104:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1789042880.757123:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789042880.762378:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5097c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267585664:12345-0@lo:13: Request processed in 5289us (6983us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042880.762397:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1789042880.763445:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a6f1e2300 x1875947267585664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042896 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789042880.763481:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267585664:0@lo:13: 00010000:00010000:0.0:1789042880.889955:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789042881.102232:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042881.102588:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242394368 00000100:00100000:3.0:1789042881.102603:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242394368 00000100:00100000:3.0:1789042881.102682:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 135 00000100:00100000:3.0:1789042881.102696:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43885c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+8:5595:x1875947242394368:12345-192.168.203.17@tcp:101: 00010000:00010000:3.0:1789042881.102726:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789042881.102773:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a6fc28c00/0x99260d7389c05ebb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676827 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042881.102815:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a6fc28c00/0x99260d7389c05ebb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676827 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042881.102829:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a6fc28c00/0x99260d7389c05ebb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676827 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042881.102849:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc28c00, rc 0) 00000100:00100000:3.0:1789042881.102939:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43885c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+9:5595:x1875947242394368:12345-192.168.203.17@tcp:101: Request processed in 247us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042881.102948:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 135 00000100:00100000:1.0:1789042881.112583:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042881.114343:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242394496 00000100:00100000:3.0:1789042881.114362:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242394496 00000100:00100000:3.0:1789042881.114451:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 136 00000100:00100000:3.0:1789042881.114465:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43885050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+9:5595:x1875947242394496:12345-192.168.203.17@tcp:501: 00000100:00100000:3.0:1789042881.114929:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43885050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+9:5595:x1875947242394496:12345-192.168.203.17@tcp:501: Request processed in 463us (2359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042881.114938:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 136 00000100:00100000:1.0:1789042881.119183:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042881.123028:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242394624 00000100:00100000:0.0:1789042881.123049:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242394624 00000100:00100000:0.0:1789042881.123213:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 137 00000100:00100000:0.0:1789042881.123227:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+9:5595:x1875947242394624:12345-192.168.203.17@tcp:503: 00000100:00100000:0.0:1789042881.125026:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+9:5595:x1875947242394624:12345-192.168.203.17@tcp:503: Request processed in 1788us (5844us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042881.125042:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 137 00000100:00100000:2.0:1789042881.132819:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042881.133141:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242394752 00000100:00100000:0.0:1789042881.133157:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242394752 00000100:00100000:0.0:1789042881.133222:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 138 00000100:00100000:0.0:1789042881.133235:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+9:6067:x1875947242394752:12345-192.168.203.17@tcp:502: 00000100:00100000:0.0:1789042881.133622:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+9:6067:x1875947242394752:12345-192.168.203.17@tcp:502: Request processed in 388us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042881.133632:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 138 00000100:00100000:1.0:1789042881.136984:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042881.137196:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242394880 00000100:00100000:0.0:1789042881.137210:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242394880 00000100:00100000:0.0:1789042881.137285:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 139 00000100:00100000:0.0:1789042881.137296:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+9:6067:x1875947242394880:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789042881.137890:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+9:6067:x1875947242394880:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 593us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042881.138581:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 139 00000100:00100000:1.0:1789042881.142168:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042881.142452:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242395008 00000100:00100000:3.0:1789042881.142465:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242395008 00000100:00100000:3.0:1789042881.142584:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 140 00000100:00100000:3.0:1789042881.142599:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+9:5595:x1875947242395008:12345-192.168.203.17@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789042881.142622:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789042881.142646:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a6fc29400/0x99260d7389c05ec2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca67682e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042881.142709:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a6fc29400/0x99260d7389c05ec2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67682e expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042881.142723:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a6fc29400/0x99260d7389c05ec2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67682e expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042881.142735:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc29400, rc 0) 00000100:00100000:3.0:1789042881.142812:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:5595:x1875947242395008:12345-192.168.203.17@tcp:101:ll_cfg_requeue.0 Request processed in 216us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042881.142819:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 140 00000100:00100000:2.0:1789042881.145488:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042881.145632:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242395136 00000100:00100000:0.0:1789042881.145645:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242395136 00000100:00100000:0.0:1789042881.145711:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 141 00000100:00100000:0.0:1789042881.145723:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:5595:x1875947242395136:12345-192.168.203.17@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789042881.146081:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:5595:x1875947242395136:12345-192.168.203.17@tcp:501:ll_cfg_requeue.0 Request processed in 358us (607us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789042881.146091:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 141 10000000:01000000:2.0:1789042881.331821:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789042881.331832:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa06a7924a000 from 39 10000000:01000000:2.0:1789042881.331847:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789042881.331916:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a58604c00/0x99260d7389c05ec9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042881.331931:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a58604c00/0x99260d7389c05ec9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042881.331945:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a58604c00/0x99260d7389c05ec9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042881.331977:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267585792:0@lo:101: 00000100:00100000:2.0:1789042881.332092:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042881.332158:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa069411eff00 going to sleep for 11 seconds 00000100:00100000:0.0:1789042881.332375:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267585792 00000100:00100000:0.0:1789042881.332386:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267585792 00000100:00100000:0.0:1789042881.332449:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789042881.332459:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+12:5844:x1875947267585792:12345-0@lo:101: 00010000:00010000:0.0:1789042881.332475:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789042881.332491:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a40030600/0x99260d7389c05ed0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05ec9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042881.332549:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a40030600/0x99260d7389c05ed0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05ec9 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042881.332560:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a40030600/0x99260d7389c05ed0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05ec9 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042881.332571:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a40030600, rc 0) 00000100:00100000:0.0:1789042881.332822:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:5844:x1875947267585792:12345-0@lo:101: Request processed in 363us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042881.332830:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789042881.333251:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267585792:0@lo:101: 00010000:00010000:2.0:1789042881.333274:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a58604c00/0x99260d7389c05ec9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05ed0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042881.333285:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a58604c00/0x99260d7389c05ec9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05ed0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042881.333370:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267585920:0@lo:501: 00000100:00100000:2.0:1789042881.333405:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042881.333439:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa069411eff00 going to sleep for 11 seconds 00000100:00100000:3.0:1789042881.333494:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267585920 00000100:00100000:3.0:1789042881.333500:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267585920 00000100:00100000:3.0:1789042881.333564:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789042881.333573:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:5844:x1875947267585920:12345-0@lo:501: 00000100:00100000:3.0:1789042881.334095:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:5844:x1875947267585920:12345-0@lo:501: Request processed in 512us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042881.334104:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789042881.334434:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267585920:0@lo:501: 00000100:00100000:2.0:1789042881.334479:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267586048:0@lo:503: 00000100:00100000:2.0:1789042881.334567:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042881.334769:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267586048 00000100:00100000:0.0:1789042881.334783:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267586048 00000100:00100000:0.0:1789042881.334827:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789042881.334838:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:5844:x1875947267586048:12345-0@lo:503: 00000100:00100000:2.0:1789042881.335051:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa069411eff00 going to sleep for 11 seconds 00000100:00100000:0.0:1789042881.336821:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:5844:x1875947267586048:12345-0@lo:503: Request processed in 1973us (2241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042881.336836:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789042881.338966:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267586048:0@lo:503: 00000100:00100000:1.0:1789042881.342975:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a5097e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:8469:1875947267586176:0@lo:502: 00000100:00100000:1.0:1789042881.343173:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042881.343235:0:8469:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a482520c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789042881.343391:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267586176 00000100:00100000:0.0:1789042881.343403:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267586176 00000100:00100000:0.0:1789042881.343557:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789042881.343569:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:8469:x1875947267586176:12345-0@lo:502: 00000100:00100000:0.0:1789042881.344110:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:8469:x1875947267586176:12345-0@lo:502: Request processed in 541us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042881.344121:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789042881.344243:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a5097e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:8469:1875947267586176:0@lo:502: 00000100:00100000:1.0:1789042881.344309:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a5097e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:8469:1875947267586304:0@lo:502: 00000100:00100000:1.0:1789042881.344362:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042881.345257:0:8469:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a482520c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789042881.345378:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267586304 00000100:00100000:3.0:1789042881.345387:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267586304 00000100:00100000:3.0:1789042881.345438:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789042881.345449:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:8469:x1875947267586304:12345-0@lo:502: 00000100:00100000:3.0:1789042881.346093:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:8469:x1875947267586304:12345-0@lo:502: Request processed in 642us (1727us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042881.346104:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789042881.346302:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a5097e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:8469:1875947267586304:0@lo:502: 00000040:00080000:1.0:1789042881.347384:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789042881.349773:0:5844:0:(obd_config.c:2243:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1789042881.349824:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789042881.349870:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a58604c00/0x99260d7389c05ec9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05ed0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042881.349885:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a58604c00/0x99260d7389c05ec9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05ed0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789042881.349898:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1789042881.349901:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1789042881.349905:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789042881.349955:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28000/0x99260d7389c05ed7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042881.349965:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28000/0x99260d7389c05ed7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042881.349978:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28000/0x99260d7389c05ed7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042881.350006:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f834380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267586432:0@lo:101: 00000100:00100000:3.0:1789042881.350210:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042881.350273:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a44d1f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789042881.350980:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267586432 00000100:00100000:1.0:1789042881.350993:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267586432 00000100:00100000:1.0:1789042881.351057:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789042881.351089:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+13:5844:x1875947267586432:12345-0@lo:101: 00010000:00010000:1.0:1789042881.351127:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789042881.351150:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a41687a00/0x99260d7389c05ede lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05ed7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042881.351183:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a41687a00/0x99260d7389c05ede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05ed7 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042881.351198:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a41687a00/0x99260d7389c05ede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05ed7 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042881.351209:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41687a00, rc 0) 00000100:00100000:1.0:1789042881.351279:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+14:5844:x1875947267586432:12345-0@lo:101: Request processed in 213us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042881.351288:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789042881.351984:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f834380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267586432:0@lo:101: 00010000:00010000:3.0:1789042881.352011:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28000/0x99260d7389c05ed7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05ede expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042881.352023:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28000/0x99260d7389c05ed7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05ede expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042881.352228:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f834380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267586560:0@lo:501: 00000100:00100000:3.0:1789042881.352294:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042881.352415:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a44d1f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789042881.352498:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267586560 00000100:00100000:2.0:1789042881.352538:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267586560 00000100:00100000:2.0:1789042881.352580:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789042881.352793:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+14:5844:x1875947267586560:12345-0@lo:501: 00000100:00100000:2.0:1789042881.353157:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+14:5844:x1875947267586560:12345-0@lo:501: Request processed in 366us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042881.353791:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f834380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267586560:0@lo:501: 00000100:00100000:3.0:1789042881.353856:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f834380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267586688:0@lo:503: 00000100:00100000:3.0:1789042881.353917:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042881.353944:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a44d1f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789042881.365814:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267586688 00000100:00100000:0.0:1789042881.365849:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267586688 00000100:00100000:0.0:1789042881.365922:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789042881.365934:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:5844:x1875947267586688:12345-0@lo:503: 00000100:00100000:0.0:1789042881.366277:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:5844:x1875947267586688:12345-0@lo:503: Request processed in 343us (12357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042881.366286:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789042881.366894:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f834380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267586688:0@lo:503: 00000100:00100000:1.0:1789042881.368337:0:8470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a5097e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:8470:1875947267586816:0@lo:502: 00000100:00100000:1.0:1789042881.368435:0:8470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042881.368488:0:8470:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a48252480 going to sleep for 11 seconds 00000100:00100000:0.0:1789042881.370329:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267586816 00000100:00100000:0.0:1789042881.370349:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267586816 00000100:00100000:0.0:1789042881.370430:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789042881.370441:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:8470:x1875947267586816:12345-0@lo:502: 00000100:00100000:0.0:1789042881.371919:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:8470:x1875947267586816:12345-0@lo:502: Request processed in 1469us (3474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042881.371935:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789042881.377459:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789042881.377774:0:8470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a5097e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:8470:1875947267586816:0@lo:502: 00000020:01000000:3.0:1789042881.377848:0:8470:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789042881.377864:0:8470:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789042881.377867:0:8470:0:(obd_config.c:1661:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789042881.377875:0:8470:0:(obd_config.c:1570:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789042881.377932:0:8470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f834380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:8470:1875947267586944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789042881.378027:0:8470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042881.378206:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267586944 00000100:00100000:1.0:1789042881.378216:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267586944 00000100:00100000:1.0:1789042881.378272:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789042881.378284:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+14:8470:x1875947267586944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789042881.378593:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+14:8470:x1875947267586944:12345-0@lo:502:llog_process_th.0 Request processed in 309us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042881.378612:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789042881.379472:0:8470:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a55382240 going to sleep for 11 seconds 00000100:00100000:3.0:1789042881.379544:0:8470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f834380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:8470:1875947267586944:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789042881.379692:0:8470:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789042881.379704:0:8470:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789042881.379707:0:8470:0:(obd_config.c:1661:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789042881.379713:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1789042881.380095:0:5844:0:(obd_config.c:2243:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1789042881.380123:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789042881.380137:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28000/0x99260d7389c05ed7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05ede expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042881.380173:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28000/0x99260d7389c05ed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05ede expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789042881.380187:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789042881.380191:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa06a7924c000 from 39 10000000:01000000:1.0:1789042881.380194:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789042881.380235:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41686c00/0x99260d7389c05ee5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042881.380244:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a41686c00/0x99260d7389c05ee5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042881.380256:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a41686c00/0x99260d7389c05ee5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042881.380282:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a5097dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267587072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789042881.380370:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042881.380406:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a48252480 going to sleep for 11 seconds 00000100:00100000:3.0:1789042881.380988:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267587072 00000100:00100000:3.0:1789042881.380999:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267587072 00000100:00100000:3.0:1789042881.381053:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789042881.381389:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+14:5844:x1875947267587072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789042881.381408:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789042881.381429:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a6fc29800/0x99260d7389c05eec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05ee5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042881.381478:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a6fc29800/0x99260d7389c05eec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05ee5 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042881.381494:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a6fc29800/0x99260d7389c05eec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05ee5 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042881.381699:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc29800, rc 0) 00000100:00100000:3.0:1789042881.381939:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:5844:x1875947267587072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 875us (1568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042881.381947:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789042881.391494:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a5097dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267587072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789042881.391707:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a41686c00/0x99260d7389c05ee5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05eec expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042881.391723:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a41686c00/0x99260d7389c05ee5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05eec expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042881.391850:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a5097dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267587200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789042881.391938:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042881.392014:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a48252480 going to sleep for 11 seconds 00000100:00100000:0.0:1789042881.393223:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267587200 00000100:00100000:0.0:1789042881.393240:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267587200 00000100:00100000:0.0:1789042881.393327:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789042881.393340:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:5844:x1875947267587200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789042881.395656:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:5844:x1875947267587200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2250us (3649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042881.395674:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789042881.395830:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a5097dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267587200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789042881.395934:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267587328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789042881.395994:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042881.396041:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa069411ef180 going to sleep for 11 seconds 00000100:00100000:0.0:1789042881.397709:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267587328 00000100:00100000:0.0:1789042881.397729:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267587328 00000100:00100000:0.0:1789042881.397812:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789042881.397823:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:5844:x1875947267587328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789042881.398151:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:5844:x1875947267587328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 328us (2156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042881.398160:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789042881.398374:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267587328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789042881.400563:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767da300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:8471:1875947267587456:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789042881.400682:0:8471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042881.400729:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffffa069411ef000 going to sleep for 11 seconds 00000100:00100000:0.0:1789042881.401019:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267587456 00000100:00100000:0.0:1789042881.401029:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267587456 00000100:00100000:0.0:1789042881.401103:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789042881.401114:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:8471:x1875947267587456:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789042881.401590:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:8471:x1875947267587456:12345-0@lo:502:llog_process_th.0 Request processed in 476us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042881.401703:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789042881.401905:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767da300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:8471:1875947267587456:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789042881.401973:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767da300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:8471:1875947267587584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789042881.402014:0:8471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042881.402052:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffffa069411ef000 going to sleep for 11 seconds 00000100:00100000:0.0:1789042881.403574:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267587584 00000100:00100000:0.0:1789042881.403588:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267587584 00000100:00100000:0.0:1789042881.403830:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789042881.403852:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:8471:x1875947267587584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789042881.404192:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:8471:x1875947267587584:12345-0@lo:502:llog_process_th.0 Request processed in 351us (2176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042881.404206:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789042881.404800:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767da300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:8471:1875947267587584:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789042881.404855:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789042881.405341:0:5844:0:(obd_config.c:2243:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789042881.405378:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789042881.405391:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41686c00/0x99260d7389c05ee5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05eec expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042881.405404:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a41686c00/0x99260d7389c05ee5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05eec expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789042881.405416:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789042881.405419:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1789042881.405423:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789042881.405468:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05ef3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042881.405476:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05ef3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042881.405486:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05ef3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042881.405938:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267587712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789042881.406013:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042881.406058:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7f8ceb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789042881.406149:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267587712 00000100:00100000:2.0:1789042881.406157:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267587712 00000100:00100000:2.0:1789042881.406213:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789042881.406224:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:5844:x1875947267587712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789042881.406238:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789042881.406256:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a58604000/0x99260d7389c05efa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05ef3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042881.406284:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a58604000/0x99260d7389c05efa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05ef3 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042881.406296:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a58604000/0x99260d7389c05efa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05ef3 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042881.406332:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a58604000, rc 0) 00000100:00100000:2.0:1789042881.406369:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:5844:x1875947267587712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042881.406376:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789042881.406701:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267587712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789042881.406720:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05ef3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05efa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042881.406742:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05ef3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05efa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042881.406884:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267587840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789042881.406917:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042881.406942:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7f8ceb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789042881.407042:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267587840 00000100:00100000:1.0:1789042881.407048:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267587840 00000100:00100000:1.0:1789042881.407155:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789042881.407165:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:5844:x1875947267587840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789042881.407808:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:5844:x1875947267587840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 642us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042881.407817:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789042881.407964:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267587840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789042881.408005:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267587968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789042881.408051:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042881.408124:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7f8ceb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789042881.408498:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267587968 00000100:00100000:3.0:1789042881.408921:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267587968 00000100:00100000:3.0:1789042881.408980:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789042881.408991:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:5844:x1875947267587968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789042881.409243:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:5844:x1875947267587968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 253us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042881.409251:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789042881.409574:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267587968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789042881.410272:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:8472:1875947267588096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789042881.410405:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042881.410453:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7f8ce540 going to sleep for 11 seconds 00000100:00100000:1.0:1789042881.410555:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267588096 00000100:00100000:1.0:1789042881.410564:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267588096 00000100:00100000:0.0:1789042881.410866:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789042881.410876:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:8472:x1875947267588096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789042881.411201:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:8472:x1875947267588096:12345-0@lo:502:llog_process_th.0 Request processed in 324us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042881.411210:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789042881.411467:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:8472:1875947267588096:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789042881.411503:0:8472:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789042881.411548:0:8472:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789042881.411551:0:8472:0:(obd_config.c:1661:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789042881.411558:0:8472:0:(obd_config.c:1570:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789042881.411592:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767da300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:8472:1875947267588224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789042881.411733:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042881.411916:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffffa069411ef180 going to sleep for 11 seconds 00000100:00100000:0.0:1789042881.412037:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267588224 00000100:00100000:0.0:1789042881.412045:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267588224 00000100:00100000:0.0:1789042881.412157:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789042881.412167:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:8472:x1875947267588224:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789042881.412584:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:8472:x1875947267588224:12345-0@lo:502:llog_process_th.0 Request processed in 417us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042881.412592:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789042881.413147:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767da300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:8472:1875947267588224:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789042881.413208:0:8472:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789042881.413216:0:8472:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789042881.413218:0:8472:0:(obd_config.c:1661:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789042881.413223:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1789042881.413690:0:5844:0:(obd_config.c:2243:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1789042881.413720:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789042881.413733:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05ef3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05efa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042881.413749:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05ef3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05efa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789042881.413937:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789042881.413941:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa06a52b8e800 from 39 10000000:01000000:2.0:1789042881.413945:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789042881.413986:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a58604800/0x99260d7389c05f01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042881.413996:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a58604800/0x99260d7389c05f01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042881.414022:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a58604800/0x99260d7389c05f01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042881.414048:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267588352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789042881.414179:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042881.414271:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa069411ef0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789042881.414381:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267588352 00000100:00100000:3.0:1789042881.414391:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267588352 00000100:00100000:3.0:1789042881.414479:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789042881.414491:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:5844:x1875947267588352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789042881.414553:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789042881.414572:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a6fc29600/0x99260d7389c05f08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05f01 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042881.414613:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a6fc29600/0x99260d7389c05f08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05f01 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042881.414626:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a6fc29600/0x99260d7389c05f08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05f01 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042881.414637:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc29600, rc 0) 00000100:00100000:3.0:1789042881.414698:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:5844:x1875947267588352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 209us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042881.414704:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789042881.414801:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267588352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789042881.414817:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a58604800/0x99260d7389c05f01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05f08 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042881.414828:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a58604800/0x99260d7389c05f01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05f08 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042881.414901:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267588480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789042881.414930:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042881.415974:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7f8ced80 going to sleep for 11 seconds 00000100:00100000:2.0:1789042881.416072:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267588480 00000100:00100000:2.0:1789042881.416080:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267588480 00000100:00100000:2.0:1789042881.416123:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789042881.416132:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:5844:x1875947267588480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789042881.416579:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:5844:x1875947267588480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 446us (1646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042881.416588:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789042881.416889:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267588480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789042881.416942:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267588608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789042881.416994:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042881.417026:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7f8ced80 going to sleep for 11 seconds 00000100:00100000:2.0:1789042881.417074:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267588608 00000100:00100000:2.0:1789042881.417079:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267588608 00000100:00100000:2.0:1789042881.417218:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789042881.417227:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:5844:x1875947267588608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789042881.417410:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:5844:x1875947267588608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 184us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042881.417417:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789042881.417488:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267588608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789042881.418800:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f834380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:8473:1875947267588736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789042881.419143:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042881.419189:0:8473:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a467dc000 going to sleep for 11 seconds 00000100:00100000:0.0:1789042881.419262:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267588736 00000100:00100000:0.0:1789042881.419271:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267588736 00000100:00100000:0.0:1789042881.419380:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789042881.419391:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:8473:x1875947267588736:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789042881.419879:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:8473:x1875947267588736:12345-0@lo:502:llog_process_th.0 Request processed in 488us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042881.419898:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789042881.420004:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f834380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:8473:1875947267588736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789042881.420068:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f834380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:8473:1875947267588864:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789042881.420105:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042881.420443:0:8473:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a467dc000 going to sleep for 11 seconds 00000100:00100000:1.0:1789042881.420627:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267588864 00000100:00100000:1.0:1789042881.420634:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267588864 00000100:00100000:1.0:1789042881.420673:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789042881.420682:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:8473:x1875947267588864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789042881.421055:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:8473:x1875947267588864:12345-0@lo:502:llog_process_th.0 Request processed in 373us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042881.421062:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789042881.421141:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f834380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:8473:1875947267588864:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789042881.421169:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789042881.421532:0:5844:0:(obd_config.c:2243:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1789042881.421557:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789042881.421570:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a58604800/0x99260d7389c05f01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05f08 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042881.421584:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a58604800/0x99260d7389c05f01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05f08 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789042881.421752:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789042881.421756:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1789042881.421761:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789042881.421799:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41686000/0x99260d7389c05f0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042881.421817:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a41686000/0x99260d7389c05f0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042881.421827:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a41686000/0x99260d7389c05f0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042881.421857:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a5097d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267588992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789042881.421904:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042881.421945:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a48252240 going to sleep for 11 seconds 00000100:00100000:3.0:1789042881.421997:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267588992 00000100:00100000:3.0:1789042881.422004:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267588992 00000100:00100000:3.0:1789042881.422036:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789042881.422052:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:5844:x1875947267588992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789042881.422064:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789042881.422079:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a6fc29a00/0x99260d7389c05f16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05f0f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042881.422108:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a6fc29a00/0x99260d7389c05f16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05f0f expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042881.422119:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a6fc29a00/0x99260d7389c05f16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05f0f expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042881.422128:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc29a00, rc 0) 00000100:00100000:3.0:1789042881.422175:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:5844:x1875947267588992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042881.422182:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789042881.422282:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a5097d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267588992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789042881.422296:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a41686000/0x99260d7389c05f0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05f16 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042881.422306:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a41686000/0x99260d7389c05f0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05f16 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042881.422731:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a5097d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267589120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789042881.422909:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042881.422971:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a48252240 going to sleep for 11 seconds 00000100:00100000:0.0:1789042881.423056:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267589120 00000100:00100000:0.0:1789042881.423063:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267589120 00000100:00100000:2.0:1789042881.424792:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789042881.424811:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:5844:x1875947267589120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789042881.425223:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:5844:x1875947267589120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 414us (2312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042881.425233:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789042881.425469:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a5097d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267589120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789042881.425625:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a5097d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267589248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789042881.425683:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042881.425723:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a48252240 going to sleep for 11 seconds 00000100:00100000:2.0:1789042881.425826:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267589248 00000100:00100000:2.0:1789042881.425834:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267589248 00000100:00100000:2.0:1789042881.425879:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789042881.425887:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46e78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:5844:x1875947267589248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789042881.426077:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46e78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:5844:x1875947267589248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042881.426085:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789042881.426413:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a5097d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267589248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789042881.426953:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:8474:1875947267589376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789042881.427014:0:8474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042881.427054:0:8474:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7f8ced80 going to sleep for 11 seconds 00000100:00100000:2.0:1789042881.427102:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267589376 00000100:00100000:2.0:1789042881.427108:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267589376 00000100:00100000:2.0:1789042881.427150:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789042881.427159:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:8474:x1875947267589376:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789042881.427419:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:8474:x1875947267589376:12345-0@lo:502:llog_process_th.0 Request processed in 260us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042881.427427:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789042881.427726:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:8474:1875947267589376:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789042881.427761:0:8474:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789042881.427775:0:8474:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789042881.427778:0:8474:0:(obd_config.c:1661:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789042881.427785:0:8474:0:(obd_config.c:1570:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789042881.427813:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:8474:1875947267589504:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789042881.427865:0:8474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042881.427892:0:8474:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a44dda840 going to sleep for 11 seconds 00000100:00100000:2.0:1789042881.427964:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267589504 00000100:00100000:2.0:1789042881.427970:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267589504 00000100:00100000:2.0:1789042881.428012:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789042881.428021:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:8474:x1875947267589504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789042881.428192:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:8474:x1875947267589504:12345-0@lo:502:llog_process_th.0 Request processed in 171us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042881.428200:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789042881.428284:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:8474:1875947267589504:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789042881.428325:0:8474:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789042881.428331:0:8474:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789042881.428332:0:8474:0:(obd_config.c:1661:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789042881.428337:0:8474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1789042881.428733:0:5844:0:(obd_config.c:2243:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1789042881.428762:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789042881.428775:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41686000/0x99260d7389c05f0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05f16 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042881.428789:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a41686000/0x99260d7389c05f0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05f16 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789042881.428807:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789042881.428809:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffffa06a5209cd88 from 1 10000000:01000000:2.0:1789042881.428813:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789042881.428855:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c05f1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042881.428864:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c05f1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042881.428874:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c05f1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042881.428894:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267589632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789042881.428935:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042881.428973:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa069411ef6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789042881.429019:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267589632 00000100:00100000:1.0:1789042881.429025:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267589632 00000100:00100000:1.0:1789042881.429062:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789042881.429071:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:5844:x1875947267589632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789042881.429082:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789042881.429097:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a41687800/0x99260d7389c05f24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05f1d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042881.429138:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a41687800/0x99260d7389c05f24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05f1d expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042881.429152:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a41687800/0x99260d7389c05f24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05f1d expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042881.429162:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41687800, rc 0) 00000100:00100000:1.0:1789042881.429198:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:5844:x1875947267589632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042881.429205:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789042881.429735:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267589632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789042881.429755:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c05f1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05f24 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042881.429767:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c05f1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05f24 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042881.429833:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267589760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789042881.429881:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042881.429919:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a44dda840 going to sleep for 11 seconds 00000100:00100000:1.0:1789042881.429971:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267589760 00000100:00100000:1.0:1789042881.429977:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267589760 00000100:00100000:1.0:1789042881.430016:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789042881.430024:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:5844:x1875947267589760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789042881.430289:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:5844:x1875947267589760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 265us (407us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789042881.430308:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789042881.430688:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267589760:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789042881.430721:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789042881.430737:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c05f1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05f24 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042881.430746:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c05f1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05f24 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042881.911320:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789042882.591303:0:8512:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffd6e0ab80 20000000:00000080:3.0:1789042882.591332:0:8512:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa06a79c70800 uarg=0000000000000000 20000000:01000000:3.0:1789042882.591381:0:8512:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789042882.591390:0:8512:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789042882.591397:0:8512:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789042882.592468:0:8513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1789042882.598948:0:8512:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1789042882.607705:0:8512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1789042882.607776:0:8512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1789042882.607861:0:8512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1789042882.607885:0:8512:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789042882.607912:0:8512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa06a6fc29c00/0x99260d7389c05f2b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042882.607938:0:8512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a429f5200/0x99260d7389c05ca0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05c99 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042882.607968:0:8512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a41687000/0x99260d7389c05d02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05cfb expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042882.607976:0:8512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a58604600/0x99260d7389c05dcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05dc6 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042882.607988:0:8512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c05e8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6767f6 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042882.607997:0:8512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa06a6fc29c00/0x99260d7389c05f2b lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042882.608053:0:8512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c05e8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6767f6 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042882.608073:0:8512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c05e8a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6767f6 expref: 9 pid: 5840 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042882.608093:0:8512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f834380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1875947267589888:192.168.203.17@tcp:104: 00010000:00010000:3.0:1789042882.608240:0:8512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a58604600/0x99260d7389c05dcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99260d7389c05dc6 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042882.608250:0:8512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa06a58604600/0x99260d7389c05dcd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99260d7389c05dc6 expref: 18 pid: 5841 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042882.608705:0:8512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f835f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1875947267590016:0@lo:104: 00000100:00100000:3.0:1789042882.608757:0:8512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789042882.608806:0:8512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a41687000/0x99260d7389c05d02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99260d7389c05cfb expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042882.608815:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267590016 00000100:00100000:0.0:1789042882.608827:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267590016 00010000:00010000:3.0:1789042882.608828:0:8512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa06a41687000/0x99260d7389c05d02 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99260d7389c05cfb expref: 18 pid: 5840 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042882.608849:0:8512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f834e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1875947267590144:0@lo:104: 00000100:00100000:3.0:1789042882.608881:0:8512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042882.608943:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1789042882.608950:0:8512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a429f5200/0x99260d7389c05ca0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99260d7389c05c99 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042882.608957:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267590144 00010000:00010000:3.0:1789042882.608961:0:8512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa06a429f5200/0x99260d7389c05ca0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99260d7389c05c99 expref: 18 pid: 5839 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042882.608961:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267590144 00000100:00100000:3.0:1789042882.608974:0:8512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f837100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1875947267590272:0@lo:104: 00000100:00100000:0.0:1789042882.608987:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789042882.609000:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f835880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+4:8512:x1875947267590016:12345-0@lo:104: 00000100:00100000:3.0:1789042882.609003:0:8512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789042882.609019:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28400/0x99260d7389c05dc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05dcd expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042882.609020:0:8512:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a467dcc00 going to sleep for 11 seconds 00010000:00010000:0.0:1789042882.609280:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789042882.609287:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f835880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+4:8512:x1875947267590016:12345-0@lo:104: Request processed in 290us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042882.609295:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789042882.609313:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267590272 00000100:00100000:0.0:1789042882.609316:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267590272 00000100:00100000:0.0:1789042882.609330:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789042882.609337:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7659b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+4:8512:x1875947267590144:12345-0@lo:104: 00010000:00010000:0.0:1789042882.609345:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05cfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05d02 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042882.609391:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789042882.609397:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7659b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+4:8512:x1875947267590144:12345-0@lo:104: Request processed in 61us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042882.609411:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789042882.609453:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789042882.609460:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f837b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+3:8512:x1875947267590272:12345-0@lo:104: 00010000:00010000:0.0:1789042882.609468:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffffa06a40031000/0x99260d7389c05c99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05ca0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042882.609494:0:8512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f835f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1875947267590016:0@lo:104: 00010000:00010000:0.0:1789042882.609501:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789042882.609507:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f837b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+3:8512:x1875947267590272:12345-0@lo:104: Request processed in 48us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042882.609510:0:8512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f834e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1875947267590144:0@lo:104: 00000100:00100000:0.0:1789042882.609538:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1789042882.609557:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789042882.609565:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28400/0x99260d7389c05dc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05dcd expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042882.609573:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc28400 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:0.0:1789042882.609577:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28400/0x99260d7389c05dc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x99260d7389c05dcd expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042882.609587:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28400/0x99260d7389c05dc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x99260d7389c05dcd expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789042882.609595:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28400/0x99260d7389c05dc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x99260d7389c05dcd expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789042882.609600:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789042882.609631:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28400/0x99260d7389c05dc6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05dcd expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042882.609633:0:8512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f837100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1875947267590272:0@lo:104: 00010000:00010000:0.0:1789042882.609644:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789042882.609686:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28400/0x99260d7389c05dc6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05dcd expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042882.609694:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28400/0x99260d7389c05dc6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05dcd expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042882.609711:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789042882.609714:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05cfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05d02 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042882.609720:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a40030400 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:0.0:1789042882.609723:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05cfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x99260d7389c05d02 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042882.609730:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05cfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x99260d7389c05d02 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789042882.609744:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05cfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x99260d7389c05d02 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789042882.609750:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789042882.609764:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05cfb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05d02 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042882.609770:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789042882.609786:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05cfb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05d02 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042882.609793:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05cfb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05d02 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042882.609805:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789042882.609815:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a40031000/0x99260d7389c05c99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05ca0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042882.609821:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a40031000 already unused, calling callback (ffffffffc1a58c20) 00000100:00100000:3.0:1789042882.609823:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3315:1875947267590400:0@lo:103:ldlm_bl.0 10000000:00010000:0.0:1789042882.609825:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a40031000/0x99260d7389c05c99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x99260d7389c05ca0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042882.609845:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a40031000/0x99260d7389c05c99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x99260d7389c05ca0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789042882.609852:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a40031000/0x99260d7389c05c99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x99260d7389c05ca0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789042882.609858:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1789042882.609872:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789042882.609875:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a40031000/0x99260d7389c05c99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05ca0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042882.609883:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789042882.609891:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a40031000/0x99260d7389c05c99 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05ca0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042882.609897:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a40031000/0x99260d7389c05c99 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05ca0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042882.609913:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789042882.609916:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789042882.609919:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789042882.609942:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267590528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789042882.609969:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042882.610000:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789042882.610006:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267590656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789042882.610035:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042882.610038:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267590400 00000100:00100000:3.0:1789042882.610045:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267590400 00000100:00100000:0.0:1789042882.610070:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267590528 00010000:00010000:3.0:1789042882.610075:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a58604600/0x99260d7389c05dcd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05dc6 expref: 19 pid: 5841 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042882.610076:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267590528 00010000:00010000:0.0:1789042882.610096:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a41687000/0x99260d7389c05d02 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05cfb expref: 20 pid: 5840 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042882.610103:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267590656 00000100:00100000:3.0:1789042882.610108:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267590656 00000100:00100000:0.0:1789042882.610124:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1789042882.610128:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a429f5200/0x99260d7389c05ca0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05c99 expref: 21 pid: 5839 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042882.610135:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f835500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+21:3315:x1875947267590400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789042882.610153:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789042882.610161:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1789042882.610162:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a58604600/0x99260d7389c05dcd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05dc6 expref: 21 pid: 5841 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042882.610173:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+21:3312:x1875947267590528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789042882.610176:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a58604600/0x99260d7389c05dcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99260d7389c05dc6 expref: 21 pid: 5841 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042882.610185:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789042882.610192:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a41687000/0x99260d7389c05d02 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05cfb expref: 21 pid: 5840 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042882.610194:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a58604600/0x99260d7389c05dcd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99260d7389c05dc6 expref: 21 pid: 5841 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042882.610214:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a41687000/0x99260d7389c05d02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99260d7389c05cfb expref: 20 pid: 5840 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042882.610274:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789042882.611324:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789042882.611490:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f835500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+20:3315:x1875947267590400:12345-0@lo:103:ldlm_bl.0 Request processed in 1351us (1611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042882.611510:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789042882.611571:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789042882.611583:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3312:x1875947267590656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789042882.611605:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789042882.611614:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a429f5200/0x99260d7389c05ca0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05c99 expref: 19 pid: 5839 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042882.611628:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a429f5200/0x99260d7389c05ca0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99260d7389c05c99 expref: 19 pid: 5839 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042882.611664:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a429f5200/0x99260d7389c05ca0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99260d7389c05c99 expref: 19 pid: 5839 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042882.611679:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789042882.611713:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:3312:x1875947267590656:12345-0@lo:103:ldlm_bl.0 Request processed in 134us (1677us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042882.611720:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1789042882.616237:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a41687000/0x99260d7389c05d02 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99260d7389c05cfb expref: 17 pid: 5840 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042882.616282:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789042882.616387:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:3312:x1875947267590528:12345-0@lo:103:ldlm_bl.0 Request processed in 6215us (6415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042882.616400:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789042882.616574:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042882.616605:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242395264 00000100:00100000:0.0:1789042882.616617:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242395264 00010000:00010000:0.0:1789042882.616657:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c05e8a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6767f6 expref: 10 pid: 5840 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042882.616689:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 24 00000100:00100000:0.0:1789042882.616700:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:2352:x1875947242395264:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789042882.616719:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789042882.616725:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c05e8a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6767f6 expref: 10 pid: 5840 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042882.616739:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c05e8a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6767f6 expref: 10 pid: 5840 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042882.616772:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa06a6fc29c00/0x99260d7389c05f2b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042882.616782:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a6fc29c00/0x99260d7389c05f2b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042882.616801:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa06a6fc29c00/0x99260d7389c05f2b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042882.616828:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa06a6fc29c00/0x99260d7389c05f2b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042882.616844:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa06a6fc29c00/0x99260d7389c05f2b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042882.616852:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa06a6fc29c00/0x99260d7389c05f2b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042882.616858:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc29c00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789042882.616862:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa06a6fc29c00/0x99260d7389c05f2b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042882.616870:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa06a6fc29c00/0x99260d7389c05f2b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042882.616879:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa06a6fc29c00/0x99260d7389c05f2b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042882.616891:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789042882.616935:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:2352:x1875947242395264:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 237us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042882.616942:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 24 00000100:00100000:1.0:1789042882.617173:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267590656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789042882.617186:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267590528:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789042882.617479:0:8512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c05e8a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6767f6 expref: 9 pid: 5840 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042882.617497:0:8512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f834380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1875947267589888:192.168.203.17@tcp:104: 00010000:00010000:3.0:1789042882.617543:0:8512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa06a6fc29c00/0x99260d7389c05f2b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042882.617554:0:8512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa06a6fc29c00/0x99260d7389c05f2b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042882.617572:0:8512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa06a6fc29c00/0x99260d7389c05f2b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042882.617593:0:8512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a6fc29c00/0x99260d7389c05f2b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042882.619478:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3315:1875947267590400:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789042882.930765:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789042882.987391:0:5844:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789042882.987403:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa06a7924a000 from 4 10000000:01000000:0.0:1789042882.987412:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789042882.987483:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05f32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042882.987556:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05f32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042882.987573:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05f32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042882.987610:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267590784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789042882.987720:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042882.987781:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a50a62240 going to sleep for 11 seconds 00000100:00100000:1.0:1789042882.987971:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267590784 00000100:00100000:1.0:1789042882.987982:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267590784 00000100:00100000:1.0:1789042882.988056:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789042882.988068:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:5844:x1875947267590784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789042882.988085:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789042882.988104:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a41687600/0x99260d7389c05f39 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05f32 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042882.988133:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a41687600/0x99260d7389c05f39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05f32 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042882.988145:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a41687600/0x99260d7389c05f39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05f32 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042882.988155:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41687600, rc 0) 00000100:00100000:1.0:1789042882.988220:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:5844:x1875947267590784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042882.988227:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789042882.989096:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267590784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789042882.989122:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05f32 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05f39 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042882.989136:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05f32 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05f39 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042882.989235:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267590912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789042882.989282:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042882.989328:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a50a62240 going to sleep for 11 seconds 00000100:00100000:1.0:1789042882.989558:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267590912 00000100:00100000:1.0:1789042882.989565:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267590912 00000100:00100000:1.0:1789042882.989611:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789042882.989619:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:5844:x1875947267590912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789042882.990134:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:5844:x1875947267590912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 514us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042882.990143:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789042882.990473:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267590912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789042882.990721:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267591040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789042882.990779:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042882.990821:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a50a62240 going to sleep for 11 seconds 00000100:00100000:2.0:1789042882.990943:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267591040 00000100:00100000:2.0:1789042882.990951:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267591040 00000100:00100000:2.0:1789042882.991004:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789042882.991014:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:5844:x1875947267591040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789042882.991242:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:5844:x1875947267591040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 229us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042882.991250:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789042882.991422:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267591040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789042882.992331:0:8527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f834380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:8527:1875947267591168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789042882.992397:0:8527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042882.992481:0:8527:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a76602d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789042882.992785:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267591168 00000100:00100000:1.0:1789042882.992793:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267591168 00000100:00100000:1.0:1789042882.992857:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789042882.992867:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:8527:x1875947267591168:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789042882.993380:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:8527:x1875947267591168:12345-0@lo:502:llog_process_th.0 Request processed in 513us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042882.993390:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789042882.993734:0:8527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f834380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:8527:1875947267591168:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789042882.993771:0:8527:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789042882.993784:0:8527:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789042882.993787:0:8527:0:(obd_config.c:1661:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789042882.993795:0:8527:0:(obd_config.c:2102:class_config_llog_handler()) cmd ce032, instance name: general-ffffa06a7924a000 00000020:00000080:3.0:1789042882.993798:0:8527:0:(obd_config.c:1570:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789042882.995737:0:8527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f834380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:8527:1875947267591296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789042882.995863:0:8527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042882.995925:0:8527:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a76602d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789042882.996312:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267591296 00000100:00100000:1.0:1789042882.996322:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267591296 00000100:00100000:1.0:1789042882.996431:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789042882.996444:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:8527:x1875947267591296:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789042882.996753:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:8527:x1875947267591296:12345-0@lo:502:llog_process_th.0 Request processed in 311us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042882.996761:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789042882.996884:0:8527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f834380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:8527:1875947267591296:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789042882.996920:0:8527:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789042882.996929:0:8527:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789042882.996931:0:8527:0:(obd_config.c:1661:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789042882.996937:0:8527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789042883.001883:0:5844:0:(obd_config.c:2243:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789042883.001933:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789042883.001949:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05f32 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05f39 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042883.001965:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05f32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05f39 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789042883.001977:0:5844:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789042883.001981:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa06a7924c000 from 4 10000000:01000000:1.0:1789042883.001991:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789042883.002041:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41687e00/0x99260d7389c05f40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042883.002051:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a41687e00/0x99260d7389c05f40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042883.002063:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a41687e00/0x99260d7389c05f40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042883.002097:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a5097d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267591424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789042883.002187:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042883.002427:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a6d27d000 going to sleep for 11 seconds 00000100:00100000:2.0:1789042883.010867:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267591424 00000100:00100000:2.0:1789042883.010892:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267591424 00000100:00100000:2.0:1789042883.010992:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789042883.011005:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:5844:x1875947267591424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789042883.011028:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789042883.011054:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a58605c00/0x99260d7389c05f47 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05f40 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042883.011092:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a58605c00/0x99260d7389c05f47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05f40 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042883.011106:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a58605c00/0x99260d7389c05f47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05f40 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042883.011117:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a58605c00, rc 0) 00000100:00100000:2.0:1789042883.011241:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:5844:x1875947267591424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 238us (9054us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042883.011249:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789042883.011333:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a5097d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267591424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789042883.011356:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a41687e00/0x99260d7389c05f40 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05f47 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042883.011367:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a41687e00/0x99260d7389c05f40 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05f47 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042883.011457:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267591552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789042883.011501:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042883.011568:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a6ecd03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789042883.011584:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267591552 00000100:00100000:2.0:1789042883.011588:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267591552 00000100:00100000:2.0:1789042883.011624:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789042883.011631:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:5844:x1875947267591552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789042883.011955:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:5844:x1875947267591552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 324us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042883.011963:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789042883.011999:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267591552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789042883.012045:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267591680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789042883.012095:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042883.012109:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a6ecd03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789042883.012122:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267591680 00000100:00100000:2.0:1789042883.012126:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267591680 00000100:00100000:2.0:1789042883.012144:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789042883.012150:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:5844:x1875947267591680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789042883.012314:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:5844:x1875947267591680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042883.012321:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789042883.012359:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267591680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789042883.017498:0:8530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767d9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:8530:1875947267591808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789042883.017646:0:8530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042883.017703:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267591808 00000100:00100000:2.0:1789042883.017712:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267591808 00000100:00100000:2.0:1789042883.017766:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789042883.017778:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:8530:x1875947267591808:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789042883.018083:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:8530:x1875947267591808:12345-0@lo:502:llog_process_th.0 Request processed in 305us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042883.018100:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789042883.018171:0:8530:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a6ecd03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789042883.018198:0:8530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767d9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:8530:1875947267591808:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789042883.019377:0:8530:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789042883.019393:0:8530:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789042883.019396:0:8530:0:(obd_config.c:1661:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789042883.019405:0:8530:0:(obd_config.c:2102:class_config_llog_handler()) cmd ce032, instance name: general-ffffa06a7924c000 00000020:00000080:2.0:1789042883.019408:0:8530:0:(obd_config.c:1570:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789042883.020056:0:8530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767d9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:8530:1875947267591936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789042883.020138:0:8530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042883.020185:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267591936 00000100:00100000:2.0:1789042883.020193:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267591936 00000100:00100000:0.0:1789042883.021645:0:8530:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a6ecd03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789042883.021815:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789042883.021839:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:8530:x1875947267591936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789042883.022190:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:8530:x1875947267591936:12345-0@lo:502:llog_process_th.0 Request processed in 362us (2049us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042883.022198:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789042883.026680:0:8530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767d9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:8530:1875947267591936:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789042883.026748:0:8530:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789042883.026759:0:8530:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789042883.026762:0:8530:0:(obd_config.c:1661:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789042883.026777:0:8530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789042883.029216:0:5844:0:(obd_config.c:2243:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789042883.029266:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789042883.029281:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41687e00/0x99260d7389c05f40 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05f47 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042883.029297:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a41687e00/0x99260d7389c05f40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05f47 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789042883.029309:0:5844:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789042883.029313:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa06a52b8e800 from 4 10000000:01000000:0.0:1789042883.029317:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789042883.029368:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a40031000/0x99260d7389c05f4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042883.029377:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a40031000/0x99260d7389c05f4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042883.029390:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a40031000/0x99260d7389c05f4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042883.029423:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267592064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789042883.029541:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042883.029601:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a50a62480 going to sleep for 11 seconds 00000100:00100000:2.0:1789042883.032309:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267592064 00000100:00100000:2.0:1789042883.032643:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267592064 00000100:00100000:2.0:1789042883.032736:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789042883.032748:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:5844:x1875947267592064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789042883.032770:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789042883.032792:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a58604200/0x99260d7389c05f55 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05f4e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042883.032841:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a58604200/0x99260d7389c05f55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05f4e expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042883.032869:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a58604200/0x99260d7389c05f55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05f4e expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042883.032880:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a58604200, rc 0) 00000100:00100000:2.0:1789042883.033087:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:5844:x1875947267592064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 341us (3571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042883.033094:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789042883.033683:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267592064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789042883.033709:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a40031000/0x99260d7389c05f4e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05f55 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042883.033720:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a40031000/0x99260d7389c05f4e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05f55 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042883.033819:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267592192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789042883.035567:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042883.035628:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a6ecd0180 going to sleep for 11 seconds 00000100:00100000:3.0:1789042883.035632:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267592192 00000100:00100000:3.0:1789042883.035643:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267592192 00000100:00100000:3.0:1789042883.035697:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789042883.035708:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:5844:x1875947267592192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789042883.036077:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:5844:x1875947267592192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 369us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042883.036086:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789042883.036666:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267592192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789042883.036731:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f834380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267592320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789042883.036780:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042883.036810:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a76602d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789042883.036825:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267592320 00000100:00100000:3.0:1789042883.037277:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267592320 00000100:00100000:3.0:1789042883.037329:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789042883.037338:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a472e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:5844:x1875947267592320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789042883.038362:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a472e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:5844:x1875947267592320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1017us (1574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042883.038373:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789042883.038490:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f834380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267592320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789042883.048888:0:8532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a5097ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:8532:1875947267592448:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789042883.049015:0:8532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042883.049108:0:8532:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a48275c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789042883.059627:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267592448 00000100:00100000:3.0:1789042883.059652:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267592448 00000100:00100000:3.0:1789042883.059744:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789042883.059757:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a472e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:8532:x1875947267592448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789042883.060135:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a472e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:8532:x1875947267592448:12345-0@lo:502:llog_process_th.0 Request processed in 379us (11118us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042883.060145:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789042883.062778:0:8532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a5097ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:8532:1875947267592448:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789042883.062851:0:8532:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789042883.062867:0:8532:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789042883.062870:0:8532:0:(obd_config.c:1661:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789042883.062880:0:8532:0:(obd_config.c:2102:class_config_llog_handler()) cmd ce032, instance name: general-ffffa06a52b8e800 00000020:00000080:1.0:1789042883.062882:0:8532:0:(obd_config.c:1570:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789042883.063340:0:8532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a5097ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:8532:1875947267592576:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789042883.063437:0:8532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042883.063488:0:8532:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a48275c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789042883.063545:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267592576 00000100:00100000:1.0:1789042883.063554:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267592576 00000100:00100000:1.0:1789042883.063640:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789042883.063651:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46e5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:8532:x1875947267592576:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789042883.063938:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46e5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:8532:x1875947267592576:12345-0@lo:502:llog_process_th.0 Request processed in 287us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042883.063946:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789042883.064006:0:8532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a5097ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:8532:1875947267592576:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789042883.064033:0:8532:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789042883.064039:0:8532:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789042883.064041:0:8532:0:(obd_config.c:1661:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789042883.064045:0:8532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789042883.067882:0:5844:0:(obd_config.c:2243:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789042883.067940:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789042883.067956:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a40031000/0x99260d7389c05f4e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05f55 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042883.067972:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a40031000/0x99260d7389c05f4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05f55 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042883.833195:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267592704:0@lo:400:kworker.0 00000100:00100000:0.0:1789042883.833297:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042883.833449:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267592704 00000100:00100000:1.0:1789042883.833460:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267592704 00000100:00100000:1.0:1789042883.833551:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789042883.833563:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267592704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789042883.836244:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267592704:12345-0@lo:400:kworker.0 Request processed in 2668us (2932us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042883.836263:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789042883.838866:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875947267592832:0@lo:400:kworker.0 00000100:00100000:3.0:1789042883.838962:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042883.840067:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267592832 00000100:00100000:1.0:1789042883.840081:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267592832 00000100:00100000:1.0:1789042883.840162:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789042883.840199:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875947267592832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789042883.840289:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875947267592832:12345-0@lo:400:kworker.0 Request processed in 100us (1326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042883.840297:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1789042883.840326:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789042883.840575:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875947267592832:0@lo:400:kworker.0 00000100:00100000:0.0:1789042883.844336:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267592704:0@lo:400:kworker.0 00000100:00100000:0.0:1789042883.847492:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267593216:0@lo:400:kworker.0 00000100:00100000:2.0:1789042883.847552:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875947267593088:0@lo:400:kworker.0 00000100:00100000:2.0:1789042883.847641:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042883.847706:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042883.847708:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789042883.847716:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267592960:0@lo:400:kworker.0 00000100:00100000:1.0:1789042883.847892:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267593088 00000100:00100000:1.0:1789042883.847903:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267593088 00000100:00100000:1.0:1789042883.847991:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789042883.848004:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875947267593088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789042883.848059:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267593216 00000100:00100000:0.0:1789042883.848065:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267593216 00000100:00100000:2.0:1789042883.849391:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042883.849484:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267592960 00000100:00100000:2.0:1789042883.849493:0:8215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267592960 00000100:00100000:2.0:1789042883.849587:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789042883.849599:0:8215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267592960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789042883.849606:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789042883.849619:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267593216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789042883.849689:0:8215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267592960:12345-0@lo:400:kworker.0 Request processed in 92us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042883.849694:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267593216:12345-0@lo:400:kworker.0 Request processed in 67us (1977us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042883.849703:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789042883.849792:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875947267593088:12345-0@lo:400:kworker.0 Request processed in 1789us (2152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042883.849802:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1789042883.849854:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789042883.849859:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789042883.849862:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789042883.850056:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a767dbb80 x1875947267592960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042883.850074:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267592960:0@lo:400:kworker.0 00000100:00100000:2.0:1789042883.850088:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875947267593088:0@lo:400:kworker.0 00010000:00080000:1.0:1789042883.850751:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a767daa00 x1875947267593216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789042883.850765:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267593216:0@lo:400:kworker.0 00000100:00100000:0.0:1789042883.851534:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1789042883.959483:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789042884.243401:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042884.243845:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242395392 00000100:00100000:2.0:1789042884.243859:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242395392 00000100:00100000:2.0:1789042884.243920:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 189 00000100:00100000:2.0:1789042884.243932:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46e5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+9:5595:x1875947242395392:12345-192.168.203.17@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789042884.243955:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789042884.243979:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a58605200/0x99260d7389c05f5c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676835 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042884.244018:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a58605200/0x99260d7389c05f5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676835 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042884.244032:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a58605200/0x99260d7389c05f5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676835 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042884.244042:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a58605200, rc 0) 00000100:00100000:2.0:1789042884.244120:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46e5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:5595:x1875947242395392:12345-192.168.203.17@tcp:101:ll_cfg_requeue.0 Request processed in 189us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042884.244128:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 189 00000100:00100000:0.0:1789042884.246716:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042884.247370:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242395520 00000100:00100000:2.0:1789042884.247386:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242395520 00000100:00100000:2.0:1789042884.247450:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 190 00000100:00100000:2.0:1789042884.247462:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46e5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:5595:x1875947242395520:12345-192.168.203.17@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789042884.247857:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46e5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:5595:x1875947242395520:12345-192.168.203.17@tcp:501:ll_cfg_requeue.0 Request processed in 396us (1151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042884.247867:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 190 00000100:00100000:0.0:1789042884.261763:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042884.263159:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242395648 00000100:00100000:3.0:1789042884.263178:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242395648 00000100:00100000:3.0:1789042884.263318:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 191 00000100:00100000:3.0:1789042884.263330:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46e5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:5595:x1875947242395648:12345-192.168.203.17@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789042884.264830:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46e5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:5595:x1875947242395648:12345-192.168.203.17@tcp:503:ll_cfg_requeue.0 Request processed in 1482us (3062us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042884.264843:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 191 00000100:00100000:3.0:1789042884.284755:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042884.285188:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242395776 00000100:00100000:2.0:1789042884.285201:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242395776 00000100:00100000:2.0:1789042884.285268:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 192 00000100:00100000:2.0:1789042884.285281:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43887850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:6131:x1875947242395776:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789042884.285633:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43887850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:6131:x1875947242395776:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 354us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042884.285642:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 192 00000100:00100000:3.0:1789042884.289663:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042884.290416:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242395904 00000100:00100000:1.0:1789042884.290430:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242395904 00000100:00100000:1.0:1789042884.290501:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 193 00000100:00100000:1.0:1789042884.290530:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43886450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:6131:x1875947242395904:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789042884.290878:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43886450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:6131:x1875947242395904:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 364us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042884.290889:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 193 00000100:00100000:1.0:1789042884.305240:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042884.305279:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042884.305308:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042884.305314:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242396032 00000100:00100000:3.0:1789042884.305329:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242396032 00000100:00100000:3.0:1789042884.305417:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 38 00000100:00100000:3.0:1789042884.305430:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5097ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2349:x1875947242396032:12345-192.168.203.17@tcp:400:kworker.0 00000100:00080000:1.0:1789042884.305500:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789042884.305546:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5097ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2349:x1875947242396032:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 118us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042884.305555:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 38 00000100:00100000:2.0:1789042884.305681:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242396160 00000100:00100000:2.0:1789042884.305685:0:8215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242396160 00000100:00100000:2.0:1789042884.305730:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242396288 00000100:00100000:2.0:1789042884.305733:0:8215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242396288 00000100:00100000:2.0:1789042884.305757:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 18 00000100:00100000:2.0:1789042884.305764:0:8215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5097ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2350:x1875947242396160:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1789042884.305796:0:8215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5097ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2350:x1875947242396160:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 33us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042884.305802:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 18 00000100:00080000:1.0:1789042884.305855:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789042884.305859:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789042884.305895:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 19 00000100:00100000:2.0:1789042884.305904:0:8215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5097f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2349:x1875947242396288:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1789042884.305945:0:8215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5097f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2349:x1875947242396288:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 43us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042884.305951:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 19 00000100:00100000:3.0:1789042884.344546:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267593344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789042884.344639:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042884.344775:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267593344 00000100:00100000:2.0:1789042884.344785:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267593344 00000100:00100000:2.0:1789042884.344855:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789042884.344865:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f834e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267593344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789042884.344909:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789042884.344966:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f834e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267593344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042884.344973:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1789042884.345065:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a767d9500 x1875947267593344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042884.345088:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267593344:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789042884.978985:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789042885.876371:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267593472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789042885.876466:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042885.876584:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267593472 00000100:00100000:2.0:1789042885.876595:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267593472 00000100:00100000:2.0:1789042885.877112:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789042885.877123:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267593472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789042885.877170:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789042885.877381:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789042885.877416:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267593472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042885.877425:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1789042885.877492:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a767dbb80 x1875947267593472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042901 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042885.877660:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267593472:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789042886.002730:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789042887.027303:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789042888.051658:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789042888.739000:0:8812:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg317-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1789042888.949872:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267593984:0@lo:400:kworker.0 00000100:00100000:3.0:1789042888.949946:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042888.950004:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789042888.950011:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267593600:0@lo:400:kworker.0 00000100:00100000:3.0:1789042888.950040:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042888.950064:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875947267594112:0@lo:400:kworker.0 00000100:00100000:3.0:1789042888.950087:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042888.950116:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267593728:0@lo:400:kworker.0 00000100:00100000:3.0:1789042888.950139:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042888.950155:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267594240:0@lo:400:kworker.0 00000100:00100000:3.0:1789042888.950176:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042888.950195:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789042888.950201:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267593856:0@lo:400:kworker.0 00000100:00100000:3.0:1789042888.950361:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042888.950394:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267593984 00000100:00100000:3.0:1789042888.950402:0:8215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267593984 00000100:00100000:3.0:1789042888.950536:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267594240 00000100:00100000:3.0:1789042888.950541:0:8215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267594240 00000100:00100000:3.0:1789042888.950566:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789042888.950575:0:8215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f837480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267593984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042888.950627:0:8215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f837480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267593984:12345-0@lo:400:kworker.0 Request processed in 52us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042888.950635:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789042888.950651:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789042888.950670:0:8215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942107800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267594240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042888.950703:0:8215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942107800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267594240:12345-0@lo:400:kworker.0 Request processed in 34us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042888.950709:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789042888.950853:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267593600 00000100:00100000:3.0:1789042888.950858:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267593600 00000100:00100000:3.0:1789042888.950914:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1789042888.950921:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43886850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3312:x1875947267593600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042888.950949:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43886850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3312:x1875947267593600:12345-0@lo:400:kworker.0 Request processed in 29us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042888.950954:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789042888.955164:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267594112 00000100:00100000:0.0:1789042888.955178:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267594112 00000100:00100000:0.0:1789042888.955250:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267593728 00000100:00100000:0.0:1789042888.955254:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267593728 00000100:00100000:0.0:1789042888.955269:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267593856 00000100:00100000:0.0:1789042888.955272:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267593856 00000100:00100000:0.0:1789042888.955294:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789042888.955303:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a520c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875947267594112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789042888.955387:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a520c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875947267594112:12345-0@lo:400:kworker.0 Request processed in 84us (5298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042888.955394:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789042888.955420:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789042888.955426:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267593728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789042888.955456:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267593728:12345-0@lo:400:kworker.0 Request processed in 31us (5316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042888.955462:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789042888.955473:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789042888.955479:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267593856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789042888.955537:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267593856:12345-0@lo:400:kworker.0 Request processed in 59us (5176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042888.955543:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1789042888.956580:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789042888.956588:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789042888.956591:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789042888.957355:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267593856:0@lo:400:kworker.0 00000100:00100000:3.0:1789042888.957372:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267593728:0@lo:400:kworker.0 00010000:00080000:3.0:1789042888.957384:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7f835880 x1875947267594240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042888.957395:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267594240:0@lo:400:kworker.0 00000100:00100000:3.0:1789042888.957680:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267593600:0@lo:400:kworker.0 00000100:00100000:3.0:1789042888.957692:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875947267594112:0@lo:400:kworker.0 00010000:00080000:3.0:1789042888.957703:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7f836680 x1875947267593984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042888.957714:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267593984:0@lo:400:kworker.0 00010000:00010000:0.0:1789042889.074894:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789042889.425707:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042889.425766:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042889.425829:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042889.425855:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042889.425887:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242396800 00000100:00100000:3.0:1789042889.425896:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242396800 00000100:00100000:3.0:1789042889.425950:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242396672 00000100:00100000:3.0:1789042889.425953:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242396672 00000100:00100000:3.0:1789042889.425974:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 22 00000100:00100000:3.0:1789042889.425983:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942106300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2349:x1875947242396800:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1789042889.426051:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942106300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2349:x1875947242396800:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 68us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042889.426058:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 22 00000100:00100000:3.0:1789042889.426073:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 23 00000100:00100000:3.0:1789042889.426079:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942106d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2349:x1875947242396672:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1789042889.426100:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942106d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2349:x1875947242396672:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 21us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042889.426105:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 23 00000100:00100000:2.0:1789042889.426198:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242396416 00000100:00100000:2.0:1789042889.426202:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242396416 00000100:00100000:2.0:1789042889.426238:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 195 00000100:00100000:2.0:1789042889.426246:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43887050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:2349:x1875947242396416:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1789042889.426275:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43887050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:2349:x1875947242396416:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 30us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042889.426281:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 195 00000100:00080000:2.0:1789042889.426324:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789042889.426328:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789042889.426599:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242396544 00000100:00100000:1.0:1789042889.426605:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242396544 00000100:00100000:1.0:1789042889.426642:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 42 00000100:00100000:1.0:1789042889.426654:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942104a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2349:x1875947242396544:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1789042889.426690:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942104a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2349:x1875947242396544:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 41us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042889.426696:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 42 00000100:00080000:2.0:1789042889.426831:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789042889.461444:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789042889.461466:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267594368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789042889.461555:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042889.461616:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267594368 00000100:00100000:2.0:1789042889.461624:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267594368 00000100:00100000:2.0:1789042889.461669:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789042889.461678:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267594368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789042889.461711:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789042889.461753:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267594368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042889.461941:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1789042889.461998:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a767dbb80 x1875947267594368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042905 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042889.462016:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267594368:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789042890.110227:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789042890.995111:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267594496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789042890.995210:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042890.995508:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267594496 00000100:00100000:0.0:1789042890.995561:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267594496 00000100:00100000:0.0:1789042890.995644:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789042890.995658:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f836680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267594496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789042890.995704:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789042890.995764:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f836680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267594496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042890.995782:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1789042890.995838:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a767dbb80 x1875947267594496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042906 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789042890.995841:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789042890.995860:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267594496:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789042891.129718:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789042892.147874:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789042893.181155:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789042894.067965:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267594624:0@lo:400:kworker.0 00000100:00100000:3.0:1789042894.068024:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267595008:0@lo:400:kworker.0 00000100:00100000:1.0:1789042894.068047:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042894.074676:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042894.074719:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875947267595136:0@lo:400:kworker.0 00000100:00100000:3.0:1789042894.074763:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267594752:0@lo:400:kworker.0 00000100:00100000:1.0:1789042894.074801:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042894.074805:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875947267594880:0@lo:400:kworker.0 00000100:00100000:0.0:1789042894.074937:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267595008 00000100:00100000:0.0:1789042894.074946:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267595008 00000100:00100000:0.0:1789042894.075004:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789042894.075013:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267595008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042894.075458:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042894.075481:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267595136 00000100:00100000:1.0:1789042894.075487:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267595136 00000100:00100000:1.0:1789042894.075548:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267594880 00000100:00100000:1.0:1789042894.075552:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267594880 00000100:00100000:1.0:1789042894.075580:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789042894.075589:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5097c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875947267595136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789042894.075606:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267595008:12345-0@lo:400:kworker.0 Request processed in 592us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042894.075615:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789042894.075635:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5097c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875947267595136:12345-0@lo:400:kworker.0 Request processed in 46us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042894.075644:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789042894.075651:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789042894.075656:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875947267594880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789042894.075709:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875947267594880:12345-0@lo:400:kworker.0 Request processed in 56us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042894.075716:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875947267595136:0@lo:400:kworker.0 00000100:00100000:0.0:1789042894.075729:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1789042894.075827:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789042894.075832:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789042894.075957:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267594624 00000100:00100000:3.0:1789042894.075962:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267594624 00000100:00100000:3.0:1789042894.076001:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1789042894.076008:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267594624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042894.076047:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267594624:12345-0@lo:400:kworker.0 Request processed in 40us (8001us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042894.076054:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1789042894.076082:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042894.076103:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267595264:0@lo:400:kworker.0 00000100:00100000:3.0:1789042894.076124:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042894.076148:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267595264 00000100:00100000:3.0:1789042894.076152:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267595264 00000100:00100000:3.0:1789042894.076181:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789042894.076187:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267595264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042894.076220:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267595264:12345-0@lo:400:kworker.0 Request processed in 32us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042894.076227:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1789042894.076243:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789042894.076262:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a46ff5500 x1875947267595264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042894.076273:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267595264:0@lo:400:kworker.0 00000100:00100000:3.0:1789042894.076294:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875947267594880:0@lo:400:kworker.0 00010000:00080000:3.0:1789042894.076315:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7f836a00 x1875947267595008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042894.076325:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267595008:0@lo:400:kworker.0 00000100:00100000:3.0:1789042894.076338:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267594752 00000100:00100000:3.0:1789042894.076341:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267594752 00000100:00100000:3.0:1789042894.076367:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789042894.076373:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267594752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042894.076404:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267594752:12345-0@lo:400:kworker.0 Request processed in 31us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042894.076410:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789042894.076434:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267594752:0@lo:400:kworker.0 00000100:00100000:1.0:1789042894.076469:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267594624:0@lo:400:kworker.0 00010000:00010000:2.0:1789042894.199383:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789042894.346341:0:9056:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg317-server.virtnet: executing yml_node 00000100:00100000:2.0:1789042894.552851:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042894.552906:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042894.553385:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242397184 00000100:00100000:0.0:1789042894.553396:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242397184 00000100:00100000:0.0:1789042894.553461:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242397312 00000100:00100000:0.0:1789042894.553465:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242397312 00000100:00100000:0.0:1789042894.553490:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00100000:0.0:1789042894.553499:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2348:x1875947242397184:12345-192.168.203.17@tcp:9:kworker.0 00000020:00000080:0.0:1789042894.553552:0:6690:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x99260d7389c05e98 00000100:00080000:0.0:1789042894.553560:0:6690:0:(import.c:65:import_set_state_nolock()) ffffa06a52b63000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789042894.553594:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789042894.553914:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+2:2348:x1875947242397184:12345-192.168.203.17@tcp:9:kworker.0 Request processed in 415us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042894.553922:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00100000:0.0:1789042894.553937:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00100000:0.0:1789042894.553944:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2348:x1875947242397312:12345-192.168.203.17@tcp:9:kworker.0 00000020:00000080:0.0:1789042894.553958:0:6690:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x99260d7389c05e9f 00000100:00080000:2.0:1789042894.554561:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789042894.554565:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789042894.554687:0:6690:0:(import.c:65:import_set_state_nolock()) ffffa06a7ab50800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789042894.554720:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789042894.554944:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+2:2348:x1875947242397312:12345-192.168.203.17@tcp:9:kworker.0 Request processed in 999us (2036us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042894.554952:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 11 00010000:00010000:2.0:1789042894.555028:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789042894.555299:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789042894.557699:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042894.557738:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042894.557775:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242397056 00000100:00100000:1.0:1789042894.557784:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242397056 00000100:00100000:1.0:1789042894.557846:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 46 00000100:00100000:1.0:1789042894.557857:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5097e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2352:x1875947242397056:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1789042894.557923:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5097e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2352:x1875947242397056:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 69us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042894.557931:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 46 00000100:00080000:1.0:1789042894.557955:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789042894.558863:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242396928 00000100:00100000:3.0:1789042894.558871:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242396928 00000100:00100000:3.0:1789042894.561104:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 197 00000100:00100000:3.0:1789042894.561122:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43885850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:2352:x1875947242396928:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1789042894.561270:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43885850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:2352:x1875947242396928:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 152us (3578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042894.561277:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 197 00000100:00100000:2.0:1789042894.582077:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267595392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789042894.582158:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042894.582242:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267595392 00000100:00100000:2.0:1789042894.582250:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267595392 00000100:00100000:2.0:1789042894.582309:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789042894.582319:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267595392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789042894.582352:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789042894.582394:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267595392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042894.582401:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1789042894.582443:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a6f1e2d80 x1875947267595392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042910 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042894.582461:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267595392:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789042895.222897:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789042895.662060:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3fb32839-ebfd-4c0f-90e4-f036c86704df 00000020:00000080:1.0:1789042895.662070:0:6716:0:(genops.c:893:class_export_put()) final put ffffa06a52b61800/3fb32839-ebfd-4c0f-90e4-f036c86704df 00000020:00000080:3.0:1789042895.662186:0:470:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a52b61800/3fb32839-ebfd-4c0f-90e4-f036c86704df for lustre-OST0000 00000020:00000080:3.0:1789042895.662230:0:470:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffffa06a52b63000 for lustre-OST0000 00000100:00100000:3.0:1789042896.114846:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267595520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789042896.114923:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042896.115083:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267595520 00000100:00100000:2.0:1789042896.115092:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267595520 00000100:00100000:2.0:1789042896.115169:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789042896.115179:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267595520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789042896.115212:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789042896.115273:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267595520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042896.115281:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1789042896.115394:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789042896.115425:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a767d8380 x1875947267595520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042912 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042896.115443:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267595520:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789042896.243051:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789042897.267411:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789042898.293977:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789042898.735258:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3fb32839-ebfd-4c0f-90e4-f036c86704df 00000020:00000080:0.0:1789042898.735267:0:7647:0:(genops.c:893:class_export_put()) final put ffffa06a52b65800/3fb32839-ebfd-4c0f-90e4-f036c86704df 00000020:00000080:3.0:1789042898.735322:0:470:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a52b65800/3fb32839-ebfd-4c0f-90e4-f036c86704df for lustre-OST0001 00000020:00000080:3.0:1789042898.735371:0:470:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffffa06a7ab50800 for lustre-OST0001 00000001:02000400:0.0:1789042899.092114:0:9251:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.2 00000100:00100000:1.0:1789042899.200172:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267595648:0@lo:400:kworker.0 00000100:00100000:1.0:1789042899.200264:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042899.200349:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267595648 00000100:00100000:3.0:1789042899.200357:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267595648 00000100:00100000:3.0:1789042899.200430:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1789042899.200440:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267595648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042899.201779:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267595648:12345-0@lo:400:kworker.0 Request processed in 1334us (1508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042899.201790:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789042899.201929:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267596032:0@lo:400:kworker.0 00000100:00100000:2.0:1789042899.201970:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042899.202004:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789042899.202010:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875947267596160:0@lo:400:kworker.0 00000100:00100000:2.0:1789042899.202060:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042899.202090:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267595776:0@lo:400:kworker.0 00000100:00100000:2.0:1789042899.202132:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042899.202154:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267596288:0@lo:400:kworker.0 00000100:00100000:2.0:1789042899.202175:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042899.202194:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789042899.202200:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267595904:0@lo:400:kworker.0 00000100:00100000:2.0:1789042899.202220:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042899.202249:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267596160 00000100:00100000:2.0:1789042899.202255:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267596160 00000100:00100000:2.0:1789042899.202294:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267595776 00000100:00100000:2.0:1789042899.202297:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267595776 00000100:00100000:2.0:1789042899.202311:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267595904 00000100:00100000:2.0:1789042899.202313:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267595904 00000100:00100000:2.0:1789042899.202328:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789042899.202336:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875947267596160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789042899.202381:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875947267596160:12345-0@lo:400:kworker.0 Request processed in 45us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042899.202388:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789042899.202418:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789042899.202426:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267595776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789042899.202460:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267595776:12345-0@lo:400:kworker.0 Request processed in 36us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042899.202467:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789042899.202480:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789042899.202487:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267595904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789042899.202549:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267595904:12345-0@lo:400:kworker.0 Request processed in 63us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042899.202555:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789042899.202577:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267596032 00000100:00100000:2.0:1789042899.202580:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267596032 00000100:00100000:2.0:1789042899.202606:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267596288 00000100:00100000:2.0:1789042899.202609:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267596288 00000100:00100000:2.0:1789042899.202629:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789042899.202635:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267596032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789042899.202661:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267596032:12345-0@lo:400:kworker.0 Request processed in 27us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042899.202667:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789042899.202678:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789042899.202683:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267596288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789042899.202726:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267596288:12345-0@lo:400:kworker.0 Request processed in 21us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042899.202733:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1789042899.202752:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789042899.202755:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789042899.202757:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789042899.202798:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875947267596160:0@lo:400:kworker.0 00010000:00080000:2.0:1789042899.202811:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a767dad80 x1875947267596032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042899.202821:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267596032:0@lo:400:kworker.0 00000100:00100000:2.0:1789042899.202847:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267595904:0@lo:400:kworker.0 00000100:00100000:2.0:1789042899.202854:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267595776:0@lo:400:kworker.0 00010000:00080000:2.0:1789042899.202862:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a767d9c00 x1875947267596288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042899.202869:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267596288:0@lo:400:kworker.0 00000100:00100000:1.0:1789042899.203935:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267595648:0@lo:400:kworker.0 00010000:00010000:1.0:1789042899.322228:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789042899.666974:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042899.667044:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042899.667075:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242397568 00000100:00100000:1.0:1789042899.667084:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242397568 00000100:00100000:1.0:1789042899.667145:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 50 00000100:00100000:1.0:1789042899.667154:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5097f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2352:x1875947242397568:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1789042899.667223:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5097f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2352:x1875947242397568:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 71us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042899.667252:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 50 00000100:00080000:1.0:1789042899.667274:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789042899.668943:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242397440 00000100:00100000:3.0:1789042899.668957:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242397440 00000100:00100000:3.0:1789042899.669009:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 199 00000100:00100000:3.0:1789042899.669017:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43885c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:2352:x1875947242397440:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1789042899.669090:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43885c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:2352:x1875947242397440:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 74us (2125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042899.669097:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 199 00000100:00100000:2.0:1789042899.698825:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267596416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789042899.698909:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042899.699050:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267596416 00000100:00100000:3.0:1789042899.699059:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267596416 00000100:00100000:3.0:1789042899.699113:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789042899.699123:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267596416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789042899.699161:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789042899.716227:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267596416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 17096us (17308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042899.716242:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1789042899.718112:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a6f1e0a80 x1875947267596416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042899.718137:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267596416:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789042900.349376:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789042901.236535:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789042901.236560:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267596544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789042901.236634:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042901.236769:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267596544 00000100:00100000:2.0:1789042901.236777:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267596544 00000100:00100000:2.0:1789042901.236840:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789042901.236850:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5097c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267596544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789042901.236882:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789042901.236926:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5097c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267596544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042901.236932:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1789042901.237009:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789042901.237039:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a767da300 x1875947267596544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042917 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789042901.237058:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267596544:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789042901.363392:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789042902.210980:0:9348:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.2 00010000:00010000:0.0:1789042902.387878:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789042903.418402:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789042904.307819:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a5097d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267596800:0@lo:400:kworker.0 00000100:00100000:1.0:1789042904.307915:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042904.307977:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a5097d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267597312:0@lo:400:kworker.0 00000100:00100000:1.0:1789042904.308007:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042904.308042:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789042904.308048:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a5097ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267596928:0@lo:400:kworker.0 00000100:00100000:1.0:1789042904.308070:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042904.308133:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a5097df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267596672:0@lo:400:kworker.0 00000100:00100000:2.0:1789042904.308179:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042904.308210:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a5097fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875947267597184:0@lo:400:kworker.0 00000100:00100000:2.0:1789042904.308233:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042904.308254:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789042904.308259:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a5097f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267597056:0@lo:400:kworker.0 00000100:00100000:2.0:1789042904.308280:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042904.308317:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267596800 00000100:00100000:2.0:1789042904.308326:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267596800 00000100:00100000:2.0:1789042904.308374:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267596928 00000100:00100000:2.0:1789042904.308377:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267596928 00000100:00100000:2.0:1789042904.308403:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267597184 00000100:00100000:2.0:1789042904.308406:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267597184 00000100:00100000:2.0:1789042904.308424:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789042904.308433:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5097dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267596800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042904.308459:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789042904.308472:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267596928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789042904.308498:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5097dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267596800:12345-0@lo:400:kworker.0 Request processed in 64us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042904.308508:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789042904.308545:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267596928:12345-0@lo:400:kworker.0 Request processed in 76us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042904.308567:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789042904.308609:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267596672 00000100:00100000:1.0:1789042904.308614:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267596672 00000100:00100000:1.0:1789042904.308649:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1789042904.308656:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43885050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267596672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789042904.308707:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43885050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267596672:12345-0@lo:400:kworker.0 Request processed in 51us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042904.308714:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:1.0:1789042904.309749:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789042904.310087:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789042904.310102:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875947267597184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789042904.310581:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875947267597184:12345-0@lo:400:kworker.0 Request processed in 482us (2345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042904.310591:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789042904.310667:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a5097df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267596672:0@lo:400:kworker.0 00000100:00100000:2.0:1789042904.310696:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a5097fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875947267597184:0@lo:400:kworker.0 00000100:00100000:3.0:1789042904.311712:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267597312 00000100:00100000:3.0:1789042904.311733:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267597312 00000100:00100000:3.0:1789042904.311981:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267597056 00000100:00100000:3.0:1789042904.311986:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267597056 00000100:00100000:3.0:1789042904.312050:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789042904.312063:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5097e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267597312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042904.312141:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5097e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267597312:12345-0@lo:400:kworker.0 Request processed in 82us (4132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042904.312144:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789042904.312371:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267597056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789042904.313653:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a5097ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267596928:0@lo:400:kworker.0 00000100:00100000:0.0:1789042904.313672:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a5097d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267596800:0@lo:400:kworker.0 00010000:00080000:0.0:1789042904.313696:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a5097d180 x1875947267597312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042904.313708:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a5097d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267597312:0@lo:400:kworker.0 00000100:00080000:0.0:1789042904.313765:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789042904.313770:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789042904.314783:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267597056:12345-0@lo:400:kworker.0 Request processed in 2407us (6494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042904.314798:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1789042904.314881:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a5097f100 x1875947267597056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042904.315009:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a5097f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267597056:0@lo:400:kworker.0 00000100:00100000:3.0:1789042904.322061:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1789042904.434787:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789042904.786054:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042904.786107:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042904.786147:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242397824 00000100:00100000:1.0:1789042904.786160:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242397824 00000100:00100000:1.0:1789042904.786237:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 54 00000100:00080000:0.0:1789042904.786264:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789042904.786735:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2352:x1875947242397824:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1789042904.786940:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2352:x1875947242397824:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 693us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042904.786949:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 54 00000100:00100000:3.0:1789042904.787235:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242397696 00000100:00100000:3.0:1789042904.787241:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242397696 00000100:00100000:3.0:1789042904.787287:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 201 00000100:00100000:3.0:1789042904.787295:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:2352:x1875947242397696:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1789042904.787333:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:2352:x1875947242397696:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 40us (1295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042904.787340:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 201 00000100:00100000:1.0:1789042904.819005:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789042904.819038:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267597440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789042904.819140:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042904.819282:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267597440 00000100:00100000:3.0:1789042904.819293:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267597440 00000100:00100000:3.0:1789042904.819357:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789042904.819367:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267597440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789042904.819418:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789042904.819556:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267597440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 190us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042904.819565:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1789042904.822782:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a6f1e3800 x1875947267597440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042920 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789042904.822818:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267597440:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1789042905.035942:0:9447:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.2 00010000:00010000:0.0:1789042905.465332:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789042906.355326:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267597568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789042906.355429:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042906.355564:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267597568 00000100:00100000:1.0:1789042906.355576:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267597568 00000100:00100000:1.0:1789042906.355651:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789042906.355677:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267597568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789042906.355722:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789042906.363688:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267597568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8004us (8235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042906.363707:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1789042906.363758:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789042906.374533:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a767d9180 x1875947267597568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042922 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042906.374575:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267597568:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789042906.486727:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789042907.028921:0:9495:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Sep 10 08:21:45 EDT 2026 00010000:00010000:0.0:1789042907.515729:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789042908.530836:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789042909.428452:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267597824:0@lo:400:kworker.0 00000100:00100000:0.0:1789042909.428452:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267598080:0@lo:400:kworker.0 00000100:00100000:3.0:1789042909.429116:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267597696:0@lo:400:kworker.0 00000100:00100000:0.0:1789042909.434533:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042909.434571:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267598080 00000100:00100000:2.0:1789042909.434586:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267598080 00000100:00100000:2.0:1789042909.434684:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789042909.434697:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267598080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789042909.434774:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267598080:12345-0@lo:400:kworker.0 Request processed in 81us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042909.434783:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789042909.435217:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875947267597952:0@lo:400:kworker.0 00000100:00100000:0.0:1789042909.435333:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789042909.435477:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7a8b4380 x1875947267598080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042909.435496:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267598080:0@lo:400:kworker.0 00000100:00080000:0.0:1789042909.435569:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789042909.440838:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267597952 00000100:00100000:2.0:1789042909.440861:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267597952 00000100:00100000:2.0:1789042909.440964:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789042909.440982:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875947267597952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789042909.441110:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875947267597952:12345-0@lo:400:kworker.0 Request processed in 136us (5777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042909.442444:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042909.442554:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267597824 00000100:00100000:1.0:1789042909.442559:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267598336:0@lo:400:kworker.0 00000100:00100000:0.0:1789042909.442563:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267597824 00000100:00100000:1.0:1789042909.442618:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042909.442620:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789042909.442630:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267597824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789042909.442691:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267598336 00000100:00100000:1.0:1789042909.442696:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267598336 00000100:00100000:0.0:1789042909.442707:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267597824:12345-0@lo:400:kworker.0 Request processed in 79us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042909.442715:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789042909.442764:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789042909.442780:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75edc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267598336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789042909.442810:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267597824:0@lo:400:kworker.0 00000100:00100000:1.0:1789042909.442957:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75edc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267598336:12345-0@lo:400:kworker.0 Request processed in 185us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042909.442965:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789042909.442967:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1789042909.443011:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789042909.443017:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789042909.443044:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875947267597952:0@lo:400:kworker.0 00010000:00080000:0.0:1789042909.443167:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7a8b6680 x1875947267598336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042909.443182:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267598336:0@lo:400:kworker.0 00000100:00100000:3.0:1789042909.443582:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042909.443660:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875947267598208:0@lo:400:kworker.0 00000100:00100000:3.0:1789042909.443692:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042909.443773:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267598208 00000100:00100000:1.0:1789042909.443779:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267598208 00000100:00100000:1.0:1789042909.443839:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789042909.443848:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875947267598208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789042909.443929:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267597696 00000100:00100000:0.0:1789042909.443934:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267597696 00000100:00100000:1.0:1789042909.449797:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875947267598208:12345-0@lo:400:kworker.0 Request processed in 5937us (6090us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042909.449958:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1789042909.450023:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789042909.450084:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875947267598208:0@lo:400:kworker.0 00000100:00100000:0.0:1789042909.450819:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789042909.450848:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267597696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789042909.450967:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267597696:12345-0@lo:400:kworker.0 Request processed in 137us (7386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042909.450992:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789042909.451338:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267597696:0@lo:400:kworker.0 00010000:00010000:2.0:1789042909.557653:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789042909.904921:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042909.904976:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042909.905060:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242397952 00000100:00100000:2.0:1789042909.905104:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242397952 00000100:00100000:2.0:1789042909.905178:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 203 00000100:00100000:2.0:1789042909.905191:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:2350:x1875947242397952:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1789042909.905278:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:2350:x1875947242397952:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 90us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042909.905286:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 203 00000100:00100000:3.0:1789042909.905632:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242398080 00000100:00100000:3.0:1789042909.905638:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242398080 00000100:00100000:3.0:1789042909.905701:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 58 00000100:00100000:3.0:1789042909.905710:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75edf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2350:x1875947242398080:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1789042909.905749:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75edf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2350:x1875947242398080:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 40us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042909.905756:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 58 00000100:00080000:1.0:1789042909.905824:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789042909.939037:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789042909.939070:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75edce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267598464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789042909.939183:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042909.939356:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267598464 00000100:00100000:1.0:1789042909.939369:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267598464 00000100:00100000:1.0:1789042909.939443:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789042909.939470:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267598464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789042909.939553:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789042909.939611:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267598464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 144us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042909.939620:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1789042909.939949:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a75edce00 x1875947267598464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042909.939972:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75edce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267598464:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789042910.579979:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789042911.474839:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789042911.474863:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267598592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789042911.474935:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042911.475137:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267598592 00000100:00100000:3.0:1789042911.475146:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267598592 00000100:00100000:3.0:1789042911.475219:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789042911.475230:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75edf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267598592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789042911.475265:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789042911.475311:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75edf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267598592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042911.475318:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1789042911.475393:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789042911.475435:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a767d9180 x1875947267598592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042927 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789042911.475453:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267598592:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789042911.602765:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789042912.636360:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789042913.654683:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789042914.550343:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267599104:0@lo:400:kworker.0 00000100:00100000:0.0:1789042914.550408:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042914.550465:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789042914.550471:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267598720:0@lo:400:kworker.0 00000100:00100000:0.0:1789042914.550499:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042914.550537:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875947267599232:0@lo:400:kworker.0 00000100:00100000:0.0:1789042914.550557:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042914.550577:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875947267598976:0@lo:400:kworker.0 00000100:00100000:0.0:1789042914.550595:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042914.550607:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789042914.550621:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875947267598848:0@lo:400:kworker.0 00000100:00100000:0.0:1789042914.550641:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042914.550657:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267599360:0@lo:400:kworker.0 00000100:00100000:0.0:1789042914.550674:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042914.550710:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267599104 00000100:00100000:0.0:1789042914.550716:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267599104 00000100:00100000:0.0:1789042914.550760:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267599360 00000100:00100000:1.0:1789042914.551328:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267599232 00000100:00100000:1.0:1789042914.551334:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267599232 00000100:00100000:1.0:1789042914.551365:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267598976 00000100:00100000:1.0:1789042914.551369:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267598976 00000100:00100000:1.0:1789042914.551386:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267598848 00000100:00100000:1.0:1789042914.551388:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267598848 00000100:00100000:1.0:1789042914.551403:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789042914.551411:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875947267599232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789042914.551470:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875947267599232:12345-0@lo:400:kworker.0 Request processed in 59us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042914.551476:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789042914.551493:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789042914.551500:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875947267598976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789042914.551547:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875947267598976:12345-0@lo:400:kworker.0 Request processed in 48us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042914.551566:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789042914.551578:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789042914.551585:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875947267598848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789042914.551628:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875947267598848:12345-0@lo:400:kworker.0 Request processed in 44us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042914.551634:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1789042914.551652:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789042914.551656:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789042914.552265:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267599360 00000100:00100000:0.0:1789042914.552310:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789042914.552316:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267599104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789042914.552351:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267599104:12345-0@lo:400:kworker.0 Request processed in 35us (1943us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042914.552356:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789042914.552366:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789042914.552377:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267599360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789042914.552400:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267599360:12345-0@lo:400:kworker.0 Request processed in 24us (1726us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042914.552405:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789042914.552421:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267598720 00000100:00100000:0.0:1789042914.552424:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267598720 00000100:00100000:0.0:1789042914.552445:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789042914.552451:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3312:x1875947267598720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789042914.552478:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3312:x1875947267598720:12345-0@lo:400:kworker.0 Request processed in 28us (1979us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042914.552483:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789042914.552548:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267598720:0@lo:400:kworker.0 00000100:00100000:0.0:1789042914.552562:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875947267599232:0@lo:400:kworker.0 00010000:00080000:0.0:1789042914.552574:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a6f1e0e00 x1875947267599104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042914.552584:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267599104:0@lo:400:kworker.0 00000100:00100000:0.0:1789042914.552628:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875947267598848:0@lo:400:kworker.0 00010000:00080000:0.0:1789042914.552638:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a6f1e1f80 x1875947267599360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042914.552645:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267599360:0@lo:400:kworker.0 00000100:00100000:0.0:1789042914.552654:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875947267598976:0@lo:400:kworker.0 00000100:00080000:1.0:1789042914.554899:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789042914.676773:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789042915.022269:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042915.022312:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042915.022336:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242398336 00000100:00100000:1.0:1789042915.022344:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242398336 00000100:00100000:1.0:1789042915.022398:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 62 00000100:00100000:1.0:1789042915.022411:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75eddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2351:x1875947242398336:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1789042915.022482:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75eddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2351:x1875947242398336:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 75us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042915.022490:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 62 00000100:00100000:1.0:1789042915.022529:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242398208 00000100:00100000:1.0:1789042915.022533:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242398208 00000100:00100000:1.0:1789042915.022559:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 205 00000100:00100000:1.0:1789042915.022566:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:2351:x1875947242398208:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1789042915.022589:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:2351:x1875947242398208:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 24us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042915.022596:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 205 00000100:00080000:1.0:1789042915.022632:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789042915.059771:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789042915.059793:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75edce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267599488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789042915.059857:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042915.059912:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267599488 00000100:00100000:1.0:1789042915.059920:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267599488 00000100:00100000:1.0:1789042915.059966:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789042915.059976:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267599488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789042915.060007:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789042915.060047:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267599488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042915.060053:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1789042915.060090:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a75edce00 x1875947267599488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042931 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789042915.060106:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75edce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267599488:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789042915.700851:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789042916.597771:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789042916.597793:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267599616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789042916.597857:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042916.598558:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267599616 00000100:00100000:3.0:1789042916.598567:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267599616 00000100:00100000:3.0:1789042916.598632:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789042916.598653:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267599616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789042916.598688:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789042916.598743:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267599616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042916.598750:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1789042916.598848:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a767da300 x1875947267599616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042932 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042916.598872:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267599616:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789042916.598942:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789042916.743417:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789042917.751406:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789042918.785733:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789042919.669969:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267599744:0@lo:400:kworker.0 00000100:00100000:1.0:1789042919.670069:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267600128:0@lo:400:kworker.0 00000100:00100000:0.0:1789042919.670075:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042919.670109:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042919.670159:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789042919.670166:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875947267600256:0@lo:400:kworker.0 00000100:00100000:2.0:1789042919.670178:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267599744 00000100:00100000:2.0:1789042919.670189:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267599744 00000100:00100000:1.0:1789042919.670208:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042919.670235:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267599872:0@lo:400:kworker.0 00000100:00100000:2.0:1789042919.670245:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789042919.670256:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267599744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789042919.670258:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042919.670277:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267600384:0@lo:400:kworker.0 00000100:00100000:2.0:1789042919.670315:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267599744:12345-0@lo:400:kworker.0 Request processed in 61us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042919.670323:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789042919.670330:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042919.670348:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789042919.670353:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267600000:0@lo:400:kworker.0 00000100:00100000:1.0:1789042919.670373:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042919.670423:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267600128 00000100:00100000:1.0:1789042919.670428:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267600128 00000100:00100000:1.0:1789042919.670480:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267600384 00000100:00100000:1.0:1789042919.670484:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267600384 00000100:00100000:1.0:1789042919.670505:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789042919.670537:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267600128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789042919.670591:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267600128:12345-0@lo:400:kworker.0 Request processed in 79us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042919.670599:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789042919.670619:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267600256 00000100:00100000:2.0:1789042919.670624:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267600256 00000100:00100000:1.0:1789042919.670626:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789042919.670633:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267600384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789042919.670652:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267599872 00000100:00100000:2.0:1789042919.670655:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267599872 00000100:00100000:1.0:1789042919.670665:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267600384:12345-0@lo:400:kworker.0 Request processed in 33us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042919.670668:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267600000 00000100:00100000:2.0:1789042919.670670:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267600000 00000100:00100000:1.0:1789042919.670672:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789042919.670683:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789042919.670689:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875947267600256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789042919.670693:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789042919.670700:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267599872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789042919.670721:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875947267600256:12345-0@lo:400:kworker.0 Request processed in 32us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042919.670724:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267599872:12345-0@lo:400:kworker.0 Request processed in 26us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042919.670731:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789042919.670734:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789042919.670744:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789042919.670749:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75edce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267600000:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789042919.670775:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789042919.670776:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75edce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267600000:12345-0@lo:400:kworker.0 Request processed in 27us (402us total) trans 0 rc 0/0 00000100:00080000:1.0:1789042919.670780:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789042919.670782:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1789042919.670782:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789042919.670824:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267600000:0@lo:400:kworker.0 00000100:00100000:1.0:1789042919.670844:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267599872:0@lo:400:kworker.0 00010000:00080000:1.0:1789042919.670858:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7a8b5f80 x1875947267600384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789042919.670868:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267600384:0@lo:400:kworker.0 00000100:00100000:1.0:1789042919.670899:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875947267600256:0@lo:400:kworker.0 00010000:00080000:1.0:1789042919.670908:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7a8b5c00 x1875947267600128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789042919.670916:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267600128:0@lo:400:kworker.0 00000100:00100000:0.0:1789042919.671565:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267599744:0@lo:400:kworker.0 00010000:00010000:2.0:1789042919.794778:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789042920.147415:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042920.147466:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042920.149110:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242398592 00000100:00100000:2.0:1789042920.149122:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242398592 00000100:00100000:2.0:1789042920.149199:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 66 00000100:00100000:2.0:1789042920.149209:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2352:x1875947242398592:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1789042920.149288:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2352:x1875947242398592:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 80us (1821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042920.149296:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 66 00000100:00080000:1.0:1789042920.149849:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789042920.150698:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242398464 00000100:00100000:0.0:1789042920.150708:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242398464 00000100:00100000:0.0:1789042920.150755:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 207 00000100:00100000:0.0:1789042920.150764:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:2352:x1875947242398464:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1789042920.150902:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:2352:x1875947242398464:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 138us (3496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042920.150910:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 207 00000100:00100000:2.0:1789042920.180068:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789042920.180091:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267600512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789042920.180156:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042920.180220:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267600512 00000100:00100000:2.0:1789042920.180228:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267600512 00000100:00100000:2.0:1789042920.180276:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789042920.180287:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267600512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789042920.180321:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789042920.180372:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267600512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042920.180380:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1789042920.180398:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7a8b5c00 x1875947267600512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042936 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042920.180424:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267600512:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789042920.819213:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789042921.715844:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267600640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789042921.715915:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042921.716048:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267600640 00000100:00100000:2.0:1789042921.716056:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267600640 00000100:00100000:2.0:1789042921.716122:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789042921.716132:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267600640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789042921.716169:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789042921.716223:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267600640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042921.716230:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1789042921.716400:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7a8b5f80 x1875947267600640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042937 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042921.716420:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267600640:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789042921.716792:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789042921.847300:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789042922.866754:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789042923.890772:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789042924.787497:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a5097f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875947267601024:0@lo:400:kworker.0 00000100:00100000:2.0:1789042924.787508:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267600896:0@lo:400:kworker.0 00000100:00100000:1.0:1789042924.787956:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267600768:0@lo:400:kworker.0 00000100:00100000:0.0:1789042924.788210:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a5097d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267601152:0@lo:400:kworker.0 00000100:00100000:2.0:1789042924.794384:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042924.794461:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a5097ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267601408:0@lo:400:kworker.0 00000100:00100000:2.0:1789042924.794503:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042924.794735:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267600896 00000100:00100000:2.0:1789042924.794743:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267600896 00000100:00100000:2.0:1789042924.794785:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789042924.794915:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5097fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267600896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789042924.795093:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5097fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267600896:12345-0@lo:400:kworker.0 Request processed in 181us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042924.795101:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789042924.795154:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267600896:0@lo:400:kworker.0 00000100:00100000:3.0:1789042924.795285:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042924.795328:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267601024 00000100:00100000:2.0:1789042924.795333:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267601024 00000100:00100000:2.0:1789042924.795368:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789042924.795376:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875947267601024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789042924.795436:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875947267601024:12345-0@lo:400:kworker.0 Request processed in 60us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042924.795442:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1789042924.795622:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789042924.795637:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267601408 00000100:00100000:2.0:1789042924.795640:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267601408 00000100:00100000:2.0:1789042924.795675:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789042924.795681:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5097df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267601408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789042924.795717:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5097df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267601408:12345-0@lo:400:kworker.0 Request processed in 36us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042924.795723:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1789042924.795738:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789042924.795756:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a5097ce00 x1875947267601408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042924.795767:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a5097ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267601408:0@lo:400:kworker.0 00000100:00100000:3.0:1789042924.796262:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a5097f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875947267601024:0@lo:400:kworker.0 00000100:00100000:1.0:1789042924.802247:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042924.802342:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a5097d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875947267601280:0@lo:400:kworker.0 00000100:00100000:1.0:1789042924.802397:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042924.802429:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267601280 00000100:00100000:1.0:1789042924.802436:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267601280 00000100:00100000:1.0:1789042924.802493:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789042924.802501:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875947267601280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789042924.802577:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875947267601280:12345-0@lo:400:kworker.0 Request processed in 76us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042924.802584:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1789042924.802610:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789042924.802652:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a5097d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875947267601280:0@lo:400:kworker.0 00000100:00100000:0.0:1789042924.812245:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042924.812297:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267601152 00000100:00100000:0.0:1789042924.812307:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267601152 00000100:00100000:0.0:1789042924.812392:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789042924.812403:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267601152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789042924.812461:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267601152:12345-0@lo:400:kworker.0 Request processed in 60us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042924.812468:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1789042924.812500:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789042924.812570:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a5097d180 x1875947267601152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042924.812584:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a5097d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267601152:0@lo:400:kworker.0 00000100:00100000:2.0:1789042924.813251:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267600768 00000100:00100000:2.0:1789042924.813258:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267600768 00000100:00100000:2.0:1789042924.813319:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789042924.813328:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267600768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789042924.813394:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267600768:12345-0@lo:400:kworker.0 Request processed in 67us (11154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042924.813401:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789042924.813450:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267600768:0@lo:400:kworker.0 00010000:00010000:0.0:1789042924.921164:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789042925.166864:0:10125:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 08:22:03 (1789042923) === 00000100:00100000:1.0:1789042925.269833:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042925.269879:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042925.270390:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242398720 00000100:00100000:0.0:1789042925.270400:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242398720 00000100:00100000:0.0:1789042925.270446:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 209 00000100:00100000:0.0:1789042925.270456:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:2352:x1875947242398720:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1789042925.270549:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:2352:x1875947242398720:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 95us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042925.270557:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 209 00000100:00100000:3.0:1789042925.271589:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242398848 00000100:00100000:3.0:1789042925.271605:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242398848 00000100:00100000:3.0:1789042925.271709:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 70 00000100:00100000:3.0:1789042925.271721:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2352:x1875947242398848:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1789042925.271808:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2352:x1875947242398848:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 89us (1929us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042925.271817:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 70 00000100:00080000:1.0:1789042925.272452:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789042925.304238:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789042925.304262:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267601536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789042925.304328:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042925.304433:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267601536 00000100:00100000:1.0:1789042925.304441:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267601536 00000100:00100000:1.0:1789042925.304503:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789042925.304549:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267601536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789042925.304584:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789042925.304905:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267601536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 277us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042925.304914:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1789042925.304964:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a6f338700 x1875947267601536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042941 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789042925.304982:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267601536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789042925.610884:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042925.610975:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242398976 00000100:00100000:0.0:1789042925.610986:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242398976 00000100:00100000:0.0:1789042925.611044:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 210 00000100:00100000:0.0:1789042925.611053:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:8125:x1875947242398976:12345-192.168.203.17@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789042925.611070:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789042925.611088:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a40031400/0x99260d7389c05f63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca67683c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042925.611132:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a40031400/0x99260d7389c05f63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67683c expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042925.611142:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a40031400/0x99260d7389c05f63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67683c expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042925.611152:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a40031400, rc 0) 00000100:00100000:0.0:1789042925.611208:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+11:8125:x1875947242398976:12345-192.168.203.17@tcp:101:mount.lustre.0 Request processed in 155us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042925.611214:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 210 00000100:00100000:1.0:1789042925.616449:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042925.616559:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242399104 00000100:00100000:2.0:1789042925.616582:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242399104 00000100:00100000:2.0:1789042925.616645:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 211 00000100:00100000:2.0:1789042925.616655:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+11:8125:x1875947242399104:12345-192.168.203.17@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789042925.616940:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+11:8125:x1875947242399104:12345-192.168.203.17@tcp:501:mount.lustre.0 Request processed in 285us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042925.616950:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 211 00000100:00100000:1.0:1789042925.633796:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042925.633902:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242399232 00000100:00100000:2.0:1789042925.633913:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242399232 00000100:00100000:2.0:1789042925.633970:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 212 00000100:00100000:2.0:1789042925.633980:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+11:8125:x1875947242399232:12345-192.168.203.17@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789042925.634221:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+11:8125:x1875947242399232:12345-192.168.203.17@tcp:503:mount.lustre.0 Request processed in 241us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042925.634229:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 212 00000100:00100000:1.0:1789042925.645262:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042925.645365:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242399360 00000100:00100000:0.0:1789042925.645376:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242399360 00000100:00100000:0.0:1789042925.645431:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 213 00000100:00100000:0.0:1789042925.645442:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+11:8129:x1875947242399360:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789042925.645782:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+11:8129:x1875947242399360:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 341us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042925.645791:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 213 00000100:00100000:3.0:1789042925.674394:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042925.674778:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242399488 00000100:00100000:1.0:1789042925.674789:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242399488 00000100:00100000:1.0:1789042925.674851:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 214 00000100:00100000:1.0:1789042925.674863:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+11:8129:x1875947242399488:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789042925.675163:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+11:8129:x1875947242399488:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 302us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042925.675173:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 214 00000100:00100000:1.0:1789042925.703075:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042925.703165:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242399616 00000100:00100000:2.0:1789042925.703174:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242399616 00000100:00100000:2.0:1789042925.703228:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 215 00000100:00100000:2.0:1789042925.703238:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+11:8125:x1875947242399616:12345-192.168.203.17@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789042925.703254:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789042925.703271:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a58605000/0x99260d7389c05f6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676866 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042925.703309:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a58605000/0x99260d7389c05f6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676866 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042925.703321:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a58605000/0x99260d7389c05f6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676866 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042925.703347:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a58605000, rc 0) 00000100:00100000:2.0:1789042925.703398:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+12:8125:x1875947242399616:12345-192.168.203.17@tcp:101:mount.lustre.0 Request processed in 161us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042925.703406:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 215 00000100:00100000:2.0:1789042925.717807:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042925.717878:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242399744 00000100:00100000:0.0:1789042925.717888:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242399744 00000100:00100000:0.0:1789042925.717941:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 216 00000100:00100000:0.0:1789042925.717951:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+12:8125:x1875947242399744:12345-192.168.203.17@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789042925.717975:0:5839:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789042925.718007:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789042925.718012:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789042925.718015:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789042925.718018:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1789042925.742443:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+12:8125:x1875947242399744:12345-192.168.203.17@tcp:256:mount.lustre.0 Request processed in 24475us (24626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042925.742459:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 216 00000100:00100000:1.0:1789042925.750832:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042925.751014:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242399872 00000100:00100000:2.0:1789042925.751026:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242399872 00000100:00100000:2.0:1789042925.751084:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 217 00000100:00100000:2.0:1789042925.751094:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+12:8125:x1875947242399872:12345-192.168.203.17@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789042925.751112:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789042925.751132:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a58604e00/0x99260d7389c05f71 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca67686d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042925.751162:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a58604e00/0x99260d7389c05f71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67686d expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042925.751173:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a58604e00/0x99260d7389c05f71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67686d expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042925.751182:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a58604e00, rc 0) 00000100:00100000:2.0:1789042925.751242:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:8125:x1875947242399872:12345-192.168.203.17@tcp:101:mount.lustre.0 Request processed in 149us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042925.751250:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 217 00000100:00100000:2.0:1789042925.761582:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042925.761798:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242400000 00000100:00100000:0.0:1789042925.761810:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242400000 00000100:00100000:0.0:1789042925.761863:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 218 00000100:00100000:0.0:1789042925.761874:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:8125:x1875947242400000:12345-192.168.203.17@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789042925.762182:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:8125:x1875947242400000:12345-192.168.203.17@tcp:501:mount.lustre.0 Request processed in 309us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042925.762191:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 218 00000100:00100000:3.0:1789042925.764478:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042925.765865:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242400128 00000100:00100000:0.0:1789042925.765879:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242400128 00000100:00100000:0.0:1789042925.765946:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 219 00000100:00100000:0.0:1789042925.765957:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:8125:x1875947242400128:12345-192.168.203.17@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789042925.766194:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:8125:x1875947242400128:12345-192.168.203.17@tcp:503:mount.lustre.0 Request processed in 238us (1725us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042925.766203:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 219 00000100:00100000:1.0:1789042925.773233:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042925.774951:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242400256 00000100:00100000:2.0:1789042925.774969:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242400256 00000100:00100000:2.0:1789042925.775056:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 220 00000100:00100000:2.0:1789042925.775067:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:8134:x1875947242400256:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789042925.775324:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:8134:x1875947242400256:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 258us (2111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042925.775333:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 220 00000100:00100000:2.0:1789042925.793159:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042925.793272:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242400384 00000100:00100000:1.0:1789042925.793286:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242400384 00000100:00100000:1.0:1789042925.793364:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 221 00000100:00100000:1.0:1789042925.793377:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:8134:x1875947242400384:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789042925.793776:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:8134:x1875947242400384:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 400us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042925.793787:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 221 00000100:00100000:3.0:1789042925.803683:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042925.806073:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242400512 00000100:00100000:1.0:1789042925.806095:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242400512 00000100:00100000:1.0:1789042925.806176:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00100000:1.0:1789042925.806187:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2348:x1875947242400512:12345-192.168.203.17@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789042925.806232:0:5845:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 0293780c-6098-470b-9b22-3d24a3d1ef2d@192.168.203.17@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:1.0:1789042925.806279:0:5845:0:(genops.c:1393:class_connect()) connect: client 0293780c-6098-470b-9b22-3d24a3d1ef2d, cookie 0x99260d7389c05f78 00000004:00100000:1.0:1789042925.806319:0:5845:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789042925.808839:0:5845:0:(import.c:65:import_set_state_nolock()) ffffa06942b63800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789042925.808937:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0293780c-6098-470b-9b22-3d24a3d1ef2d+6:2348:x1875947242400512:12345-192.168.203.17@tcp:38:mount.lustre.0 Request processed in 2749us (5269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042925.808948:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00100000:3.0:1789042925.819183:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042925.819235:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042925.823622:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242400640 00000100:00100000:0.0:1789042925.823645:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242400640 00000100:00100000:0.0:1789042925.823751:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242400768 00000100:00100000:0.0:1789042925.823756:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242400768 00000100:00100000:0.0:1789042925.823791:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00100000:0.0:1789042925.823802:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0293780c-6098-470b-9b22-3d24a3d1ef2d+7:0:x1875947242400640:12345-192.168.203.17@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789042925.823863:0:5847:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789042925.824179:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0293780c-6098-470b-9b22-3d24a3d1ef2d+7:0:x1875947242400640:12345-192.168.203.17@tcp:41:mount.lustre.0 Request processed in 376us (5011us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042925.824210:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00100000:0.0:1789042925.824241:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 12 00000100:00100000:0.0:1789042925.824249:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0293780c-6098-470b-9b22-3d24a3d1ef2d+6:8125:x1875947242400768:12345-192.168.203.17@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789042925.824261:0:5847:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789042925.824295:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0293780c-6098-470b-9b22-3d24a3d1ef2d+6:8125:x1875947242400768:12345-192.168.203.17@tcp:41:mount.lustre.0 Request processed in 46us (5059us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042925.824301:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 12 00000100:00080000:1.0:1789042925.825375:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789042925.827893:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042925.828122:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242400896 00000100:00100000:3.0:1789042925.828135:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242400896 00000100:00100000:3.0:1789042925.828273:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 13 00000100:00100000:3.0:1789042925.828285:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5097ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0293780c-6098-470b-9b22-3d24a3d1ef2d+6:8125:x1875947242400896:12345-192.168.203.17@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789042925.828398:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5097ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0293780c-6098-470b-9b22-3d24a3d1ef2d+6:8125:x1875947242400896:12345-192.168.203.17@tcp:40:mount.lustre.0 Request processed in 115us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042925.828406:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 13 00000100:00100000:3.0:1789042925.849792:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042925.849848:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042925.850566:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242401024 00000100:00100000:2.0:1789042925.850581:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242401024 00000100:00100000:2.0:1789042925.850637:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242401152 00000100:00100000:2.0:1789042925.850641:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242401152 00000100:00100000:2.0:1789042925.850673:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 12 00000100:00100000:2.0:1789042925.850683:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1875947242401024:12345-192.168.203.17@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789042925.850722:0:6691:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0293780c-6098-470b-9b22-3d24a3d1ef2d@192.168.203.17@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:2.0:1789042925.850760:0:6691:0:(genops.c:1393:class_connect()) connect: client 0293780c-6098-470b-9b22-3d24a3d1ef2d, cookie 0x99260d7389c05f7f 00002000:00100000:2.0:1789042925.850777:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0293780c-6098-470b-9b22-3d24a3d1ef2d/ffffa06a7f9e9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789042925.850805:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789042925.851362:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 13 00000100:00100000:1.0:1789042925.851370:0:8215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2348:x1875947242401152:12345-192.168.203.17@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789042925.851392:0:8215:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0293780c-6098-470b-9b22-3d24a3d1ef2d@192.168.203.17@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:1.0:1789042925.851446:0:8215:0:(genops.c:1393:class_connect()) connect: client 0293780c-6098-470b-9b22-3d24a3d1ef2d, cookie 0x99260d7389c05f86 00002000:00100000:1.0:1789042925.851453:0:8215:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0293780c-6098-470b-9b22-3d24a3d1ef2d/ffffa06942b60800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789042925.851460:0:8215:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789042925.851730:0:8215:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789042925.851773:0:8215:0:(import.c:65:import_set_state_nolock()) ffffa06942b67000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789042925.851864:0:8215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0293780c-6098-470b-9b22-3d24a3d1ef2d+6:2348:x1875947242401152:12345-192.168.203.17@tcp:8:mount.lustre.0 Request processed in 492us (2015us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042925.851873:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 13 00002000:00080000:2.0:1789042925.853268:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789042925.853315:0:6691:0:(import.c:65:import_set_state_nolock()) ffffa06a7f9eb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789042925.853381:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0293780c-6098-470b-9b22-3d24a3d1ef2d+6:2348:x1875947242401024:12345-192.168.203.17@tcp:8:mount.lustre.0 Request processed in 2697us (3603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042925.853393:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 12 00000100:00100000:2.0:1789042925.853496:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042925.860755:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242401280 00000100:00100000:3.0:1789042925.860780:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242401280 00000100:00100000:3.0:1789042925.860877:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 1 00000100:00100000:3.0:1789042925.860890:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5097d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0293780c-6098-470b-9b22-3d24a3d1ef2d+6:8125:x1875947242401280:12345-192.168.203.17@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789042925.861193:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789042925.861321:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5097d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0293780c-6098-470b-9b22-3d24a3d1ef2d+6:8125:x1875947242401280:12345-192.168.203.17@tcp:33:mount.lustre.0 Request processed in 434us (7824us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042925.861330:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 1 00010000:00010000:0.0:1789042925.942897:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789042926.407247:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0293780c-6098-470b-9b22-3d24a3d1ef2d 00000100:00100000:1.0:1789042926.834885:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789042926.834918:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a5097d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267601664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789042926.835033:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042926.835128:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267601664 00000100:00100000:3.0:1789042926.835141:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267601664 00000100:00080000:1.0:1789042926.835195:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789042926.835220:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789042926.835232:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f338700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267601664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789042926.835270:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789042926.835333:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f338700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267601664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042926.835342:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1789042926.835568:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a5097d880 x1875947267601664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042942 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789042926.835593:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a5097d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267601664:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789042926.964614:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789042927.987290:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789042928.939597:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0293780c-6098-470b-9b22-3d24a3d1ef2d 00010000:00010000:0.0:1789042929.015969:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789042929.522819:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0293780c-6098-470b-9b22-3d24a3d1ef2d 00000100:00100000:3.0:1789042929.906809:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a5097d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267601920:0@lo:400:kworker.0 00000100:00100000:2.0:1789042929.906819:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875947267602048:0@lo:400:kworker.0 00000100:00100000:0.0:1789042929.906892:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267602176:0@lo:400:kworker.0 00000100:00100000:1.0:1789042929.906965:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a5097f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267601792:0@lo:400:kworker.0 00000100:00100000:3.0:1789042929.910979:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042929.911067:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f85f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267602432:0@lo:400:kworker.0 00000100:00100000:3.0:1789042929.911106:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042929.911153:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267601920 00000100:00100000:3.0:1789042929.911161:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267601920 00000100:00100000:3.0:1789042929.911208:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789042929.911218:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267601920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042929.911276:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267601920:12345-0@lo:400:kworker.0 Request processed in 58us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042929.911283:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789042929.911619:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267602432 00000100:00100000:3.0:1789042929.911624:0:8215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267602432 00000100:00100000:3.0:1789042929.911660:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789042929.911666:0:8215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267602432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042929.911697:0:8215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267602432:12345-0@lo:400:kworker.0 Request processed in 32us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042929.911704:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1789042929.911725:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789042929.912075:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7f85f480 x1875947267602432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042929.912090:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f85f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267602432:0@lo:400:kworker.0 00000100:00100000:3.0:1789042929.912103:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a5097d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267601920:0@lo:400:kworker.0 00000100:00100000:0.0:1789042929.913369:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042929.913684:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267602176 00000100:00100000:3.0:1789042929.913691:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267602176 00000100:00100000:2.0:1789042929.913748:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042929.913756:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789042929.913776:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267602176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042929.913826:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267602176:12345-0@lo:400:kworker.0 Request processed in 51us (461us total) trans 0 rc 0/0 00010000:00080000:2.0:1789042929.913836:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7a8b5c00 x1875947267602176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042929.913845:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789042929.913849:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267602176:0@lo:400:kworker.0 00000100:00100000:2.0:1789042929.913874:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267602048 00000100:00100000:2.0:1789042929.913877:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267602048 00000100:00100000:2.0:1789042929.913914:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789042929.913922:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f85c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875947267602048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789042929.913959:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f85c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875947267602048:12345-0@lo:400:kworker.0 Request processed in 38us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042929.913965:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789042929.914001:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875947267602048:0@lo:400:kworker.0 00000100:00080000:0.0:1789042929.914063:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789042929.914068:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789042929.917674:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042929.917736:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f85e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875947267602304:0@lo:400:kworker.0 00000100:00100000:1.0:1789042929.917770:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042929.917805:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267601792 00000100:00100000:0.0:1789042929.917813:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267601792 00000100:00100000:0.0:1789042929.917876:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1789042929.917886:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267601792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789042929.917954:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267601792:12345-0@lo:400:kworker.0 Request processed in 68us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042929.917961:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789042929.918613:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a5097f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267601792:0@lo:400:kworker.0 00000100:00100000:3.0:1789042929.920316:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267602304 00000100:00100000:3.0:1789042929.920326:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267602304 00000100:00100000:3.0:1789042929.920642:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789042929.920655:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f33a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875947267602304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042929.920739:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f33a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875947267602304:12345-0@lo:400:kworker.0 Request processed in 87us (2968us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042929.920803:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f85e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875947267602304:0@lo:400:kworker.0 00000100:00080000:0.0:1789042929.923470:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789042929.923483:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00010000:2.0:1789042930.037144:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789042930.419397:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789042930.419443:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f33b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267602560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789042930.419581:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042930.420269:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267602560 00000100:00100000:0.0:1789042930.420283:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267602560 00000100:00100000:0.0:1789042930.420355:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789042930.420367:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267602560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789042930.420443:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789042930.420579:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267602560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 213us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042930.420587:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1789042930.420833:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a6f33b480 x1875947267602560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042946 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042930.420870:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f33b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267602560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789042930.899892:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042930.899938:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042930.899972:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042930.900003:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042930.900027:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042930.900062:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242401920 00000100:00100000:3.0:1789042930.900075:0:8215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242401920 00000100:00100000:2.0:1789042930.900109:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242401408 00000100:00100000:2.0:1789042930.900137:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242401408 00000100:00100000:3.0:1789042930.900164:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242401792 00000100:00100000:3.0:1789042930.900170:0:8215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242401792 00000100:00100000:3.0:1789042930.900217:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 40 00000100:00100000:2.0:1789042930.900217:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 223 00000100:00100000:3.0:1789042930.900240:0:8215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2349:x1875947242401920:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1789042930.900253:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2349:x1875947242401408:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1789042930.900340:0:8215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2349:x1875947242401920:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 104us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042930.900357:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242401664 00000100:00100000:3.0:1789042930.900368:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 40 00000100:00100000:1.0:1789042930.900387:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242401664 00000100:00100000:3.0:1789042930.900393:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 41 00000100:00100000:3.0:1789042930.900404:0:8215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5097d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2349:x1875947242401792:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1789042930.900436:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242401536 00000100:00100000:1.0:1789042930.900442:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242401536 00000100:00100000:1.0:1789042930.900490:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 74 00000100:00100000:1.0:1789042930.900508:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2349:x1875947242401664:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1789042930.900607:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 75 00000100:00100000:0.0:1789042930.900620:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5097f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2349:x1875947242401536:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1789042930.905614:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2349:x1875947242401408:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 5354us (5723us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042930.905628:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 223 00000100:00080000:2.0:1789042930.906330:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789042930.906338:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789042930.906341:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789042930.913753:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2349:x1875947242401664:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 13235us (13793us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042930.913767:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 74 00000100:00100000:2.0:1789042930.914610:0:8215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5097d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2349:x1875947242401792:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 14195us (14567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042930.914627:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 41 00000100:00100000:0.0:1789042930.914795:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5097f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2349:x1875947242401536:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 14175us (14787us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042930.914808:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 75 00010000:00010000:0.0:1789042931.059906:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789042931.613094:0:10323:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg317-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:1.0:1789042931.955848:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789042931.955870:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f85df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267602688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789042931.956011:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042931.956081:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267602688 00000100:00100000:0.0:1789042931.956088:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267602688 00000100:00100000:0.0:1789042931.956151:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789042931.956162:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f338380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267602688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789042931.956196:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789042931.956247:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f338380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267602688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042931.956254:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1789042931.958625:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7f85df80 x1875947267602688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042931.958653:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f85df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267602688:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789042931.960046:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789042932.082771:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789042933.125165:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789042934.130843:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789042935.026891:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267602944:0@lo:400:kworker.0 00000100:00100000:2.0:1789042935.026976:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042935.027041:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267603456:0@lo:400:kworker.0 00000100:00100000:2.0:1789042935.027071:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042935.027098:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789042935.027104:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267603072:0@lo:400:kworker.0 00000100:00100000:2.0:1789042935.027126:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042935.027160:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267602944 00000100:00100000:2.0:1789042935.027168:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267602944 00000100:00100000:2.0:1789042935.027205:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267603072 00000100:00100000:2.0:1789042935.027208:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267603072 00000100:00100000:2.0:1789042935.027236:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789042935.027244:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f85d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267602944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789042935.027290:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f85d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267602944:12345-0@lo:400:kworker.0 Request processed in 46us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042935.027296:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789042935.027321:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789042935.027327:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f85ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267603072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789042935.027349:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f85ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267603072:12345-0@lo:400:kworker.0 Request processed in 24us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042935.027354:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1789042935.027373:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789042935.027399:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267603072:0@lo:400:kworker.0 00000100:00100000:2.0:1789042935.027418:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267602944:0@lo:400:kworker.0 00000100:00100000:1.0:1789042935.027642:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267602816:0@lo:400:kworker.0 00000100:00100000:1.0:1789042935.027677:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042935.027709:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875947267603328:0@lo:400:kworker.0 00000100:00100000:1.0:1789042935.027730:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042935.027747:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789042935.027753:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267603200:0@lo:400:kworker.0 00000100:00100000:1.0:1789042935.027776:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042935.027848:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267603328 00000100:00100000:3.0:1789042935.027854:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267603328 00000100:00100000:3.0:1789042935.027894:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789042935.027901:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f339f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875947267603328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042935.027956:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f339f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875947267603328:12345-0@lo:400:kworker.0 Request processed in 56us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042935.027964:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789042935.027988:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875947267603328:0@lo:400:kworker.0 00000100:00080000:1.0:1789042935.028089:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789042935.028155:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267603456 00000100:00100000:0.0:1789042935.028159:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267603456 00000100:00100000:0.0:1789042935.028206:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267603200 00000100:00100000:0.0:1789042935.028210:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267603200 00000100:00100000:0.0:1789042935.028229:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789042935.028236:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a51875850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267603456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789042935.028278:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a51875850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267603456:12345-0@lo:400:kworker.0 Request processed in 42us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042935.028295:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789042935.028433:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789042935.028440:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267603200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789042935.028484:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267603200:12345-0@lo:400:kworker.0 Request processed in 45us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042935.028489:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1789042935.028549:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a46ff0a80 x1875947267603200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042935.028560:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267603200:0@lo:400:kworker.0 00010000:00080000:0.0:1789042935.028584:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a46ff0700 x1875947267603456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042935.028592:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267603456:0@lo:400:kworker.0 00000100:00080000:1.0:1789042935.028653:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789042935.028656:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789042935.028750:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267602816 00000100:00100000:2.0:1789042935.028755:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267602816 00000100:00100000:2.0:1789042935.028790:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789042935.028797:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267602816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789042935.028839:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267602816:12345-0@lo:400:kworker.0 Request processed in 43us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042935.028846:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1789042935.028935:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267602816:0@lo:400:kworker.0 00010000:00010000:2.0:1789042935.154752:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789042935.538799:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789042935.538822:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267603584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789042935.538887:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042935.539049:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267603584 00000100:00100000:3.0:1789042935.539058:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267603584 00000100:00100000:3.0:1789042935.539112:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789042935.539122:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267603584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789042935.539156:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789042935.539204:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267603584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042935.539225:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1789042935.539261:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a46ff1c00 x1875947267603584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042951 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042935.539280:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267603584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789042936.025624:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042936.025664:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042936.025690:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042936.025707:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042936.027541:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242402048 00000100:00100000:0.0:1789042936.027565:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242402048 00000100:00100000:0.0:1789042936.027628:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 225 00000100:00100000:0.0:1789042936.027639:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2352:x1875947242402048:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1789042936.027712:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2352:x1875947242402048:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 76us (2096us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042936.027720:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 225 00000100:00100000:0.0:1789042936.027758:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242402560 00000100:00100000:0.0:1789042936.027762:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242402560 00000100:00100000:0.0:1789042936.027816:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 44 00000100:00100000:0.0:1789042936.027823:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f85fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2352:x1875947242402560:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1789042936.027864:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f85fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2352:x1875947242402560:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 31us (2162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042936.027872:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 44 00000100:00100000:0.0:1789042936.027892:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242402304 00000100:00100000:0.0:1789042936.027896:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242402304 00000100:00100000:0.0:1789042936.027922:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242402176 00000100:00100000:0.0:1789042936.027925:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242402176 00000100:00100000:0.0:1789042936.027949:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 79 00000100:00100000:0.0:1789042936.027956:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f85f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2352:x1875947242402304:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1789042936.027983:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f85f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2352:x1875947242402304:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 27us (2319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042936.027989:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 79 00000100:00100000:0.0:1789042936.028000:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 80 00000100:00100000:0.0:1789042936.028007:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f85d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2352:x1875947242402176:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1789042936.028028:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f85d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2352:x1875947242402176:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 22us (2320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042936.028033:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 80 00000100:00080000:0.0:1789042936.028074:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789042936.028079:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789042936.038390:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042936.038633:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242402432 00000100:00100000:3.0:1789042936.038643:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242402432 00000100:00080000:0.0:1789042936.038769:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789042936.038832:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 45 00000100:00100000:3.0:1789042936.038845:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f85ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2352:x1875947242402432:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1789042936.038914:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f85ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2352:x1875947242402432:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 72us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042936.038921:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 45 00010000:00010000:2.0:1789042936.183258:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789042937.081151:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789042937.081173:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f85c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267603712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789042937.081239:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042937.081306:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267603712 00000100:00100000:2.0:1789042937.081313:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267603712 00000100:00100000:2.0:1789042937.081365:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789042937.081375:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f85e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267603712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789042937.081408:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789042937.081480:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f85e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267603712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042937.081487:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1789042937.081546:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789042937.081577:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7f85c000 x1875947267603712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042937.081673:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f85c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267603712:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789042937.209560:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789042938.227701:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789042939.260670:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789042940.147795:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f33b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267603968:0@lo:400:kworker.0 00000100:00100000:3.0:1789042940.147856:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042940.147924:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267604480:0@lo:400:kworker.0 00000100:00100000:3.0:1789042940.147949:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042940.147978:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789042940.147984:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f33bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267604096:0@lo:400:kworker.0 00000100:00100000:3.0:1789042940.148006:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042940.148150:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f338e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267603840:0@lo:400:kworker.0 00000100:00100000:2.0:1789042940.148186:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042940.148218:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f33aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875947267604352:0@lo:400:kworker.0 00000100:00100000:2.0:1789042940.148239:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042940.148259:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789042940.148265:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267604224:0@lo:400:kworker.0 00000100:00100000:2.0:1789042940.148285:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042940.148318:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267603968 00000100:00100000:2.0:1789042940.148325:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267603968 00000100:00100000:2.0:1789042940.148360:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267604096 00000100:00100000:2.0:1789042940.148363:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267604096 00000100:00100000:2.0:1789042940.148382:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267604352 00000100:00100000:2.0:1789042940.148385:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267604352 00000100:00100000:2.0:1789042940.148402:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789042940.148409:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267603968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789042940.148467:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267603968:12345-0@lo:400:kworker.0 Request processed in 57us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042940.148475:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789042940.148495:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789042940.148500:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267604096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789042940.148551:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267604096:12345-0@lo:400:kworker.0 Request processed in 51us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042940.148572:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789042940.148586:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789042940.148591:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f85c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875947267604352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789042940.148623:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f85c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875947267604352:12345-0@lo:400:kworker.0 Request processed in 32us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042940.148629:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789042940.148645:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267604480 00000100:00100000:2.0:1789042940.148649:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267604480 00000100:00100000:2.0:1789042940.148670:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267604224 00000100:00100000:2.0:1789042940.148673:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267604224 00000100:00100000:2.0:1789042940.148689:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789042940.148695:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267604480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789042940.148721:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267604480:12345-0@lo:400:kworker.0 Request processed in 27us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042940.148728:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789042940.148738:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789042940.148744:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f85dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267604224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789042940.148767:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f85dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267604224:12345-0@lo:400:kworker.0 Request processed in 24us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042940.148772:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1789042940.148788:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789042940.148791:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789042940.148794:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789042940.148822:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a6f339500 x1875947267604224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042940.148836:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267604224:0@lo:400:kworker.0 00000100:00100000:2.0:1789042940.148854:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f33aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875947267604352:0@lo:400:kworker.0 00000100:00100000:2.0:1789042940.148887:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f33bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267604096:0@lo:400:kworker.0 00000100:00100000:2.0:1789042940.148896:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f33b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267603968:0@lo:400:kworker.0 00010000:00080000:2.0:1789042940.149020:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a6f338000 x1875947267604480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042940.149029:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267604480:0@lo:400:kworker.0 00000100:00100000:3.0:1789042940.149143:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267603840 00000100:00100000:3.0:1789042940.149148:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267603840 00000100:00100000:3.0:1789042940.149182:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789042940.149190:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267603840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042940.149234:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267603840:12345-0@lo:400:kworker.0 Request processed in 45us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042940.149247:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789042940.149314:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f338e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267603840:0@lo:400:kworker.0 00010000:00010000:1.0:1789042940.277738:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789042940.659603:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789042940.659626:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267604608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789042940.659693:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042940.659809:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267604608 00000100:00100000:3.0:1789042940.659818:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267604608 00000100:00100000:3.0:1789042940.659868:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789042940.659877:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267604608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789042940.659907:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789042940.659960:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267604608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042940.659966:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1789042940.660610:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a46ff3480 x1875947267604608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042956 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042940.660644:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267604608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789042941.139711:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042941.139756:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042941.139777:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042941.139793:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042941.139865:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042941.139894:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242402816 00000100:00100000:2.0:1789042941.139902:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242402816 00000100:00100000:2.0:1789042941.139949:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242402944 00000100:00100000:2.0:1789042941.139951:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242402944 00000100:00100000:2.0:1789042941.139970:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 84 00000100:00100000:2.0:1789042941.139979:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f85d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2350:x1875947242402816:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1789042941.140042:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f85d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2350:x1875947242402816:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 64us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042941.140049:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 84 00000100:00100000:2.0:1789042941.140068:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 85 00000100:00100000:2.0:1789042941.140074:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f85ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2349:x1875947242402944:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1789042941.140093:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f85ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2349:x1875947242402944:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 20us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042941.140113:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 85 00000100:00100000:2.0:1789042941.140131:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242403072 00000100:00100000:2.0:1789042941.140134:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242403072 00000100:00100000:2.0:1789042941.140155:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242403200 00000100:00100000:2.0:1789042941.140157:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242403200 00000100:00100000:2.0:1789042941.140172:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 48 00000100:00100000:2.0:1789042941.140178:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f85ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2349:x1875947242403072:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1789042941.140201:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f85ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2349:x1875947242403072:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 23us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042941.140206:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 48 00000100:00100000:2.0:1789042941.140216:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 49 00000100:00100000:2.0:1789042941.140221:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f85f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2349:x1875947242403200:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1789042941.140239:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f85f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2349:x1875947242403200:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 17us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042941.140244:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 49 00000100:00080000:2.0:1789042941.140264:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789042941.140267:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789042941.140269:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789042941.140463:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242402688 00000100:00100000:3.0:1789042941.140467:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242402688 00000100:00100000:3.0:1789042941.140504:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 227 00000100:00100000:3.0:1789042941.140532:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2350:x1875947242402688:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1789042941.140561:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2350:x1875947242402688:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 50us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042941.140567:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 227 00010000:00010000:2.0:1789042941.303547:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789042942.194771:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789042942.194800:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f85c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267604736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789042942.194890:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042942.194983:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267604736 00000100:00100000:2.0:1789042942.194994:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267604736 00000100:00100000:2.0:1789042942.195071:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789042942.195081:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f85df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267604736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789042942.195143:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789042942.195195:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f85df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267604736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042942.195203:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1789042942.195239:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789042942.195293:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7f85c700 x1875947267604736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042942.195314:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f85c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267604736:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789042942.322687:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789042943.346760:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789042944.372422:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789042945.269272:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267604864:0@lo:400:kworker.0 00000100:00100000:2.0:1789042945.269350:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042945.269478:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267604864 00000100:00100000:0.0:1789042945.269488:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267604864 00000100:00100000:1.0:1789042945.269561:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267605248:0@lo:400:kworker.0 00000100:00100000:0.0:1789042945.269568:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789042945.269580:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267604864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789042945.269602:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042945.269662:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267605248 00000100:00100000:1.0:1789042945.269666:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267605248 00000100:00100000:1.0:1789042945.269701:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789042945.269712:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267605248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789042945.269751:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267605248:12345-0@lo:400:kworker.0 Request processed in 43us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042945.269759:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1789042945.269781:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789042945.269809:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a46ff0e00 x1875947267605248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789042945.269822:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267605248:0@lo:400:kworker.0 00000100:00100000:3.0:1789042945.270552:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875947267605120:0@lo:400:kworker.0 00000100:00100000:3.0:1789042945.270589:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042945.270620:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789042945.270626:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875947267604992:0@lo:400:kworker.0 00000100:00100000:3.0:1789042945.270648:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042945.270666:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267605504:0@lo:400:kworker.0 00000100:00100000:3.0:1789042945.270686:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042945.270722:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267605120 00000100:00100000:3.0:1789042945.270726:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267605120 00000100:00100000:3.0:1789042945.270776:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267604992 00000100:00100000:3.0:1789042945.270779:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267604992 00000100:00100000:3.0:1789042945.270798:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789042945.270805:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875947267605120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042945.270842:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875947267605120:12345-0@lo:400:kworker.0 Request processed in 37us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042945.270848:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789042945.270861:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789042945.270865:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875947267604992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042945.270886:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875947267604992:12345-0@lo:400:kworker.0 Request processed in 21us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042945.270890:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789042945.270906:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267605504 00000100:00100000:3.0:1789042945.270908:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267605504 00000100:00100000:3.0:1789042945.270928:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789042945.270932:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267605504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042945.270954:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267605504:12345-0@lo:400:kworker.0 Request processed in 21us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042945.270958:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1789042945.270975:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789042945.270978:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789042945.271001:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875947267604992:0@lo:400:kworker.0 00010000:00080000:3.0:1789042945.271011:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a46ff3b80 x1875947267605504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042945.271034:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267605504:0@lo:400:kworker.0 00000100:00100000:3.0:1789042945.271044:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875947267605120:0@lo:400:kworker.0 00000100:00100000:1.0:1789042945.271430:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789042945.271442:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875947267605376:0@lo:400:kworker.0 00000100:00100000:1.0:1789042945.271474:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042945.271805:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267605376 00000100:00100000:3.0:1789042945.271810:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267605376 00000100:00100000:3.0:1789042945.271854:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789042945.271861:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f33a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875947267605376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042945.271913:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f33a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875947267605376:12345-0@lo:400:kworker.0 Request processed in 52us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042945.271919:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789042945.271950:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875947267605376:0@lo:400:kworker.0 00000100:00080000:1.0:1789042945.272003:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789042945.272177:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267604864:12345-0@lo:400:kworker.0 Request processed in 2597us (2824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042945.272186:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789042945.272250:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267604864:0@lo:400:kworker.0 00010000:00010000:0.0:1789042945.398254:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789042945.778728:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267605632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789042945.778800:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042945.779169:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267605632 00000100:00100000:2.0:1789042945.779178:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267605632 00000100:00100000:2.0:1789042945.779238:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789042945.779249:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267605632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789042945.779285:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789042945.779345:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267605632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042945.779352:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1789042945.784376:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a46ff3100 x1875947267605632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042961 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042945.784410:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267605632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789042946.256009:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042946.256049:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042946.256142:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042946.256175:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042946.256205:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042946.256231:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242403584 00000100:00100000:0.0:1789042946.256241:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242403584 00000100:00100000:0.0:1789042946.256292:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242403456 00000100:00100000:0.0:1789042946.256295:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242403456 00000100:00100000:0.0:1789042946.256315:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 89 00000100:00100000:0.0:1789042946.256325:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2351:x1875947242403584:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1789042946.256403:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2351:x1875947242403584:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 68us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042946.256432:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 89 00000100:00100000:0.0:1789042946.256450:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 90 00000100:00100000:0.0:1789042946.256457:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2351:x1875947242403456:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1789042946.256481:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2351:x1875947242403456:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 24us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042946.256487:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 90 00000100:00080000:0.0:1789042946.256507:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789042946.256693:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242403328 00000100:00100000:3.0:1789042946.256706:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242403328 00000100:00100000:3.0:1789042946.256743:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 229 00000100:00100000:3.0:1789042946.256750:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2351:x1875947242403328:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1789042946.256777:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2351:x1875947242403328:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 28us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042946.256783:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 229 00000100:00100000:2.0:1789042946.258330:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242403712 00000100:00100000:2.0:1789042946.258343:0:8215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242403712 00000100:00100000:2.0:1789042946.258444:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242403840 00000100:00100000:2.0:1789042946.258447:0:8215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242403840 00000100:00100000:1.0:1789042946.258505:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 14 00000100:00100000:1.0:1789042946.258540:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2348:x1875947242403712:12345-192.168.203.17@tcp:9:kworker.0 00000020:00000080:1.0:1789042946.258573:0:6692:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x99260d7389c05f7f 00000100:00080000:1.0:1789042946.258582:0:6692:0:(import.c:65:import_set_state_nolock()) ffffa06a7f9eb800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789042946.258619:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789042946.258968:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0293780c-6098-470b-9b22-3d24a3d1ef2d+2:2348:x1875947242403712:12345-192.168.203.17@tcp:9:kworker.0 Request processed in 453us (2967us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042946.258976:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 14 00010000:00010000:1.0:1789042946.259004:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789042946.259426:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789042946.259430:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789042946.259621:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 15 00000100:00100000:3.0:1789042946.259632:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2348:x1875947242403840:12345-192.168.203.17@tcp:9:kworker.0 00000020:00000080:3.0:1789042946.259649:0:6690:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x99260d7389c05f86 00000100:00080000:3.0:1789042946.259656:0:6690:0:(import.c:65:import_set_state_nolock()) ffffa06942b67000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789042946.259683:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789042946.259916:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0293780c-6098-470b-9b22-3d24a3d1ef2d+2:2348:x1875947242403840:12345-192.168.203.17@tcp:9:kworker.0 Request processed in 285us (3865us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042946.259932:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 15 00010000:00010000:1.0:1789042946.260090:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789042946.420578:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789042946.873211:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0293780c-6098-470b-9b22-3d24a3d1ef2d 00000020:00000080:2.0:1789042946.873224:0:6716:0:(genops.c:893:class_export_put()) final put ffffa06a7f9e9800/0293780c-6098-470b-9b22-3d24a3d1ef2d 00000020:00000080:1.0:1789042946.873782:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a7f9e9800/0293780c-6098-470b-9b22-3d24a3d1ef2d for lustre-OST0000 00000020:00000080:1.0:1789042946.874012:0:36:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffffa06a7f9eb800 for lustre-OST0000 00000100:00100000:0.0:1789042947.320440:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267605760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789042947.320549:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042947.320664:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267605760 00000100:00100000:0.0:1789042947.320675:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267605760 00000100:00100000:0.0:1789042947.320754:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789042947.320776:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267605760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789042947.320830:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789042947.320887:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267605760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042947.320894:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1789042947.320921:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789042947.320973:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7a024e00 x1875947267605760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042947.320995:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267605760:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789042947.449111:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789042948.466736:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789042949.255084:0:11024:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789042949.490670:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789042949.927785:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0293780c-6098-470b-9b22-3d24a3d1ef2d 00000020:00000080:2.0:1789042949.927806:0:7647:0:(genops.c:893:class_export_put()) final put ffffa06942b60800/0293780c-6098-470b-9b22-3d24a3d1ef2d 00000020:00000080:1.0:1789042949.927928:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffffa06942b60800/0293780c-6098-470b-9b22-3d24a3d1ef2d for lustre-OST0001 00000020:00000080:1.0:1789042949.927995:0:36:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffffa06942b67000 for lustre-OST0001 00000100:00100000:2.0:1789042950.395778:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f339c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267605888:0@lo:400:kworker.0 00000100:00100000:2.0:1789042950.395881:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042950.396031:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267605888 00000100:00100000:3.0:1789042950.396042:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267605888 00000100:00100000:3.0:1789042950.396105:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1789042950.396115:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267605888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042950.398470:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267605888:12345-0@lo:400:kworker.0 Request processed in 2342us (2575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042950.398489:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789042950.398721:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f339c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267605888:0@lo:400:kworker.0 00000100:00100000:2.0:1789042950.398758:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789042950.398771:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267606272:0@lo:400:kworker.0 00000100:00100000:2.0:1789042950.398904:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042950.399079:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267606272 00000100:00100000:0.0:1789042950.399087:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267606272 00000100:00100000:0.0:1789042950.399159:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789042950.399168:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f85c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267606272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789042950.399224:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f85c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267606272:12345-0@lo:400:kworker.0 Request processed in 58us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042950.399231:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1789042950.399250:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789042950.399275:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a6f338a80 x1875947267606272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042950.399288:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267606272:0@lo:400:kworker.0 00000100:00100000:1.0:1789042950.399454:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789042950.399465:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f33b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875947267606400:0@lo:400:kworker.0 00000100:00100000:1.0:1789042950.399503:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042950.399565:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f339180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267606016:0@lo:400:kworker.0 00000100:00100000:1.0:1789042950.399590:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042950.399606:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267606528:0@lo:400:kworker.0 00000100:00100000:1.0:1789042950.399626:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042950.399644:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789042950.399650:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f33ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267606144:0@lo:400:kworker.0 00000100:00100000:1.0:1789042950.399669:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042950.399787:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267606528 00000100:00100000:1.0:1789042950.399793:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267606528 00000100:00100000:1.0:1789042950.399828:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789042950.399998:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f33b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267606528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789042950.400052:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f33b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267606528:12345-0@lo:400:kworker.0 Request processed in 217us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042950.400059:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1789042950.400137:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a6f338a80 x1875947267606528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042950.400149:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267606528:0@lo:400:kworker.0 00000100:00100000:0.0:1789042950.400325:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267606400 00000100:00100000:0.0:1789042950.400330:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267606400 00000100:00100000:0.0:1789042950.400401:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267606016 00000100:00100000:0.0:1789042950.400404:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267606016 00000100:00100000:0.0:1789042950.400418:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267606144 00000100:00100000:0.0:1789042950.400420:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267606144 00000100:00100000:0.0:1789042950.400434:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789042950.400441:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875947267606400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789042950.400496:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875947267606400:12345-0@lo:400:kworker.0 Request processed in 53us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042950.400502:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789042950.400534:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789042950.400540:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267606016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789042950.400573:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267606016:12345-0@lo:400:kworker.0 Request processed in 34us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042950.400579:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789042950.400589:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789042950.400595:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f33bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267606144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789042950.400630:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f33bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267606144:12345-0@lo:400:kworker.0 Request processed in 35us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042950.400635:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789042950.400831:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f33b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875947267606400:0@lo:400:kworker.0 00000100:00080000:1.0:1789042950.401648:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789042950.401656:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789042950.402963:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f33ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267606144:0@lo:400:kworker.0 00000100:00100000:0.0:1789042950.402987:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f339180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267606016:0@lo:400:kworker.0 00010000:00010000:1.0:1789042950.514759:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789042950.907112:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f85e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267606656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789042950.907234:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042950.907384:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267606656 00000100:00100000:2.0:1789042950.907397:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267606656 00000100:00100000:2.0:1789042950.907455:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789042950.909116:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f85f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267606656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789042950.909173:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789042950.909428:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f85f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267606656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 357us (2193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042950.909437:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1789042950.911064:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7f85e300 x1875947267606656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042966 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042950.911108:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f85e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267606656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789042951.375168:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042951.375271:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042951.375398:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242404224 00000100:00100000:3.0:1789042951.375408:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242404224 00000100:00100000:3.0:1789042951.375476:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 94 00000100:00100000:3.0:1789042951.375487:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2349:x1875947242404224:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1789042951.375601:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2349:x1875947242404224:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 115us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042951.375609:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 94 00000100:00080000:0.0:1789042951.376264:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789042951.376446:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042951.376510:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242404096 00000100:00100000:0.0:1789042951.376545:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242404096 00000100:00100000:0.0:1789042951.376589:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 95 00000100:00100000:0.0:1789042951.376598:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2350:x1875947242404096:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1789042951.376645:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2350:x1875947242404096:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 48us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042951.376652:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 95 00000100:00080000:3.0:1789042951.377344:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789042951.377651:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242403968 00000100:00100000:2.0:1789042951.377659:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242403968 00000100:00100000:3.0:1789042951.378609:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 231 00000100:00100000:3.0:1789042951.378627:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2349:x1875947242403968:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1789042951.378691:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2349:x1875947242403968:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 67us (3533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042951.378698:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 231 00010000:00010000:2.0:1789042951.539647:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789042952.434715:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789042952.435440:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267606784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789042952.436078:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042952.436263:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267606784 00000100:00100000:2.0:1789042952.436272:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267606784 00000100:00100000:2.0:1789042952.436393:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789042952.436404:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267606784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789042952.436440:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789042952.436500:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267606784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042952.436507:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1789042952.436750:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7a025180 x1875947267606784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789042952.436778:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267606784:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789042952.436966:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789042952.569487:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789042952.649271:0:11173:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc4e6f96e0 20000000:00000080:1.0:1789042952.649289:0:11173:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa06a76598000 uarg=0000000000000000 20000000:01000000:1.0:1789042952.649332:0:11173:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789042952.649338:0:11173:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789042952.649342:0:11173:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789042952.650837:0:11174:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1789042952.650980:0:11173:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789042952.660323:0:11173:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789042952.663178:0:11173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c05f8d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042952.663205:0:11173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a41687600/0x99260d7389c05f39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05f32 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042952.663213:0:11173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a58605c00/0x99260d7389c05f47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05f40 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042952.663220:0:11173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a58604200/0x99260d7389c05f55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05f4e expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042952.663230:0:11173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a58605200/0x99260d7389c05f5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676835 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042952.663237:0:11173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a58604e00/0x99260d7389c05f71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67686d expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042952.663245:0:11173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c05f8d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042952.663298:0:11173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a58604e00/0x99260d7389c05f71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67686d expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042952.663314:0:11173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa06a58604e00/0x99260d7389c05f71 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67686d expref: 12 pid: 5840 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042952.663329:0:11173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1875947267606912:192.168.203.17@tcp:104: 00010000:00010000:3.0:1789042952.663478:0:11173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a58605200/0x99260d7389c05f5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676835 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042952.663488:0:11173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa06a58605200/0x99260d7389c05f5c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676835 expref: 12 pid: 5839 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042952.663497:0:11173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1875947267607040:192.168.203.17@tcp:104: 00010000:00010000:3.0:1789042952.663569:0:11173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a58604200/0x99260d7389c05f55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99260d7389c05f4e expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042952.663578:0:11173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa06a58604200/0x99260d7389c05f55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99260d7389c05f4e expref: 18 pid: 5839 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042952.663588:0:11173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1875947267607168:0@lo:104: 00000100:00100000:3.0:1789042952.663643:0:11173:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789042952.663686:0:11173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a58605c00/0x99260d7389c05f47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99260d7389c05f40 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042952.663695:0:11173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa06a58605c00/0x99260d7389c05f47 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99260d7389c05f40 expref: 18 pid: 5841 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042952.663699:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267607168 00000100:00100000:3.0:1789042952.663707:0:11173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1875947267607296:0@lo:104: 00000100:00100000:1.0:1789042952.663708:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267607168 00000100:00100000:3.0:1789042952.663734:0:11173:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042952.663755:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267607296 00000100:00100000:1.0:1789042952.663760:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267607296 00010000:00010000:3.0:1789042952.663766:0:11173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a41687600/0x99260d7389c05f39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99260d7389c05f32 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042952.663776:0:11173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa06a41687600/0x99260d7389c05f39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99260d7389c05f32 expref: 18 pid: 5839 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042952.663781:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789042952.663791:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+4:11173:x1875947267607168:12345-0@lo:104: 00000100:00100000:3.0:1789042952.663806:0:11173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1875947267607424:0@lo:104: 00010000:00010000:1.0:1789042952.663816:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffffa06a40031000/0x99260d7389c05f4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05f55 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042952.663854:0:11173:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042952.663870:0:11173:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a46f1fc00 going to sleep for 11 seconds 00010000:00010000:1.0:1789042952.663882:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789042952.663890:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+4:11173:x1875947267607168:12345-0@lo:104: Request processed in 100us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042952.663897:0:11173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1875947267607168:0@lo:104: 00000100:00100000:1.0:1789042952.663898:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789042952.663921:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267607424 00000100:00100000:1.0:1789042952.663925:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267607424 00000100:00100000:1.0:1789042952.663939:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789042952.663951:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+4:11173:x1875947267607296:12345-0@lo:104: 00010000:00010000:1.0:1789042952.663958:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffffa06a41687e00/0x99260d7389c05f40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05f47 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042952.664016:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789042952.664022:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+4:11173:x1875947267607296:12345-0@lo:104: Request processed in 77us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042952.664028:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789042952.664042:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789042952.664050:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+3:11173:x1875947267607424:12345-0@lo:104: 00010000:00010000:1.0:1789042952.664057:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05f32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05f39 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042952.664085:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789042952.664089:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+3:11173:x1875947267607424:12345-0@lo:104: Request processed in 42us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042952.664095:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1789042952.664115:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789042952.664121:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a40031000/0x99260d7389c05f4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05f55 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042952.664128:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a40031000 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:1.0:1789042952.664133:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a40031000/0x99260d7389c05f4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x99260d7389c05f55 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042952.664141:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a40031000/0x99260d7389c05f4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x99260d7389c05f55 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789042952.664147:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a40031000/0x99260d7389c05f4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x99260d7389c05f55 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789042952.664153:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789042952.664187:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a40031000/0x99260d7389c05f4e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05f55 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042952.664194:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789042952.664206:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789042952.664215:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a40031000/0x99260d7389c05f4e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05f55 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042952.664223:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a40031000/0x99260d7389c05f4e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05f55 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042952.664236:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789042952.664245:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05f32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05f39 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042952.664251:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a40030400 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:1.0:1789042952.664254:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05f32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x99260d7389c05f39 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042952.664260:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05f32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x99260d7389c05f39 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789042952.664267:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05f32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x99260d7389c05f39 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789042952.664271:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789042952.664285:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05f32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05f39 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042952.664290:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789042952.664305:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05f32 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05f39 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042952.664322:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a40030400/0x99260d7389c05f32 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05f39 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042952.664333:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789042952.664335:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789042952.664337:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789042952.664370:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f33aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267607552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789042952.664401:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042952.665062:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3314:1875947267607680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789042952.665098:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042952.665143:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267607552 00000100:00100000:2.0:1789042952.665149:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267607552 00010000:00010000:2.0:1789042952.665173:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a58604200/0x99260d7389c05f55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05f4e expref: 19 pid: 5839 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042952.665202:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267607680 00000100:00100000:2.0:1789042952.665205:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267607680 00010000:00010000:2.0:1789042952.665216:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a41687600/0x99260d7389c05f39 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05f32 expref: 20 pid: 5839 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042952.665236:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789042952.665242:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a55f64050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+20:3313:x1875947267607552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789042952.665253:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789042952.665258:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a58604200/0x99260d7389c05f55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05f4e expref: 20 pid: 5839 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042952.665261:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789042952.665276:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f85e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+20:3314:x1875947267607680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789042952.665278:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a58604200/0x99260d7389c05f55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99260d7389c05f4e expref: 20 pid: 5839 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042952.665289:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789042952.665297:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a41687600/0x99260d7389c05f39 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05f32 expref: 20 pid: 5839 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042952.665298:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a58604200/0x99260d7389c05f55 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99260d7389c05f4e expref: 20 pid: 5839 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042952.665318:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a41687600/0x99260d7389c05f39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99260d7389c05f32 expref: 19 pid: 5839 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042952.665772:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789042952.665917:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a55f64050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267607552:12345-0@lo:103:ldlm_bl.0 Request processed in 673us (1513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042952.665926:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789042952.665989:0:11173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1875947267607296:0@lo:104: 00000100:00100000:3.0:1789042952.666002:0:11173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1875947267607424:0@lo:104: 00010000:00010000:1.0:1789042952.666070:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a41687600/0x99260d7389c05f39 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99260d7389c05f32 expref: 18 pid: 5839 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042952.666076:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f33aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267607552:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789042952.666087:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789042952.666177:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f85e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:3314:x1875947267607680:12345-0@lo:103:ldlm_bl.0 Request processed in 907us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042952.666185:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1789042952.666229:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789042952.666232:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789042952.666234:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789042952.666270:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3314:1875947267607680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789042952.669880:0:11173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1875947267606912:192.168.203.17@tcp:104: 00000100:00100000:3.0:1789042952.669896:0:11173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11173:1875947267607040:192.168.203.17@tcp:104: 00010000:00010000:3.0:1789042952.669928:0:11173:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c05f8d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042952.670374:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a41687e00/0x99260d7389c05f40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05f47 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042952.670403:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687e00 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:1.0:1789042952.670418:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a41687e00/0x99260d7389c05f40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x99260d7389c05f47 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042952.670428:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a41687e00/0x99260d7389c05f40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x99260d7389c05f47 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789042952.670443:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a41687e00/0x99260d7389c05f40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x99260d7389c05f47 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789042952.670450:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789042952.670564:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a41687e00/0x99260d7389c05f40 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05f47 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042952.670571:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789042952.670618:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a41687e00/0x99260d7389c05f40 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05f47 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042952.670626:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a41687e00/0x99260d7389c05f40 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05f47 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042952.670643:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789042952.670646:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789042952.670649:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789042952.670659:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789042952.670682:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f33b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3314:1875947267607808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789042952.670735:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042952.671746:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042952.671864:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042952.671893:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267607808 00000100:00100000:0.0:1789042952.671902:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267607808 00000100:00100000:1.0:1789042952.672029:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242404352 00000100:00100000:1.0:1789042952.672034:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242404352 00010000:00010000:1.0:1789042952.672056:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a58604e00/0x99260d7389c05f71 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67686d expref: 13 pid: 5840 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042952.672085:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242404480 00000100:00100000:1.0:1789042952.672098:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242404480 00010000:00010000:1.0:1789042952.672113:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a58605200/0x99260d7389c05f5c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676835 expref: 14 pid: 5839 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042952.672148:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 27 00000100:00100000:1.0:1789042952.672159:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a026d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+14:2352:x1875947242404352:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789042952.672173:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789042952.672178:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a58604e00/0x99260d7389c05f71 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67686d expref: 14 pid: 5840 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042952.672190:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a58604e00/0x99260d7389c05f71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67686d expref: 14 pid: 5840 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042952.672206:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a58604e00/0x99260d7389c05f71 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67686d expref: 14 pid: 5840 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042952.672222:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789042952.672265:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a026d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2352:x1875947242404352:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 108us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042952.672272:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 27 00000100:00100000:1.0:1789042952.672289:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 28 00000100:00100000:1.0:1789042952.672296:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a025180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+12:2352:x1875947242404480:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789042952.672303:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789042952.672308:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a58605200/0x99260d7389c05f5c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676835 expref: 12 pid: 5839 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042952.672318:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a58605200/0x99260d7389c05f5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676835 expref: 12 pid: 5839 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042952.672339:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a58605200/0x99260d7389c05f5c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676835 expref: 12 pid: 5839 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042952.672357:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789042952.672377:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a025180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+11:2352:x1875947242404480:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 82us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042952.672383:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 28 00010000:00010000:0.0:1789042952.673122:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a58605c00/0x99260d7389c05f47 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05f40 expref: 17 pid: 5841 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042952.673170:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789042952.673189:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a024380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:3314:x1875947267607808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789042952.673201:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789042952.673208:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a58605c00/0x99260d7389c05f47 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05f40 expref: 17 pid: 5841 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042952.673219:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a58605c00/0x99260d7389c05f47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99260d7389c05f40 expref: 17 pid: 5841 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042952.673232:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a58605c00/0x99260d7389c05f47 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99260d7389c05f40 expref: 17 pid: 5841 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042952.673246:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c05f8d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042952.673255:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c05f8d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042952.673272:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c05f8d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042952.673280:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c05f8d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042952.673287:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c05f8d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042952.673294:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c05f8d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042952.673301:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc29e00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789042952.673306:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c05f8d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042952.673322:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c05f8d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042952.673357:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c05f8d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042952.673370:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789042952.673380:0:11173:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c05f8d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042952.673391:0:11173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c05f8d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042952.673399:0:11173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c05f8d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042952.673435:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a024380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:3314:x1875947267607808:12345-0@lo:103:ldlm_bl.0 Request processed in 248us (2699us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042952.673443:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789042952.673592:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f33b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3314:1875947267607808:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789042953.586614:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789042954.256744:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042954.256784:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242404608 00000100:00100000:1.0:1789042954.256794:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242404608 00000100:00100000:1.0:1789042954.256850:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 232 00000100:00100000:1.0:1789042954.256864:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+11:5595:x1875947242404608:12345-192.168.203.17@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789042954.256883:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789042954.256903:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a41686600/0x99260d7389c05f94 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676897 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042954.256931:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a41686600/0x99260d7389c05f94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676897 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042954.256957:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a41686600/0x99260d7389c05f94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676897 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042954.256967:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41686600, rc 0) 00000100:00100000:1.0:1789042954.257028:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+12:5595:x1875947242404608:12345-192.168.203.17@tcp:101:ll_cfg_requeue.0 Request processed in 168us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042954.257035:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 232 00000100:00100000:0.0:1789042954.260468:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042954.260581:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242404736 00000100:00100000:1.0:1789042954.260602:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242404736 00000100:00100000:1.0:1789042954.260663:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 233 00000100:00100000:1.0:1789042954.260676:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46e78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+12:5595:x1875947242404736:12345-192.168.203.17@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789042954.260980:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46e78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+12:5595:x1875947242404736:12345-192.168.203.17@tcp:501:ll_cfg_requeue.0 Request processed in 305us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042954.260989:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 233 00000100:00100000:1.0:1789042954.262985:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042954.263144:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242404864 00000100:00100000:3.0:1789042954.263153:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242404864 00000100:00100000:3.0:1789042954.263202:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 234 00000100:00100000:3.0:1789042954.263211:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+12:5595:x1875947242404864:12345-192.168.203.17@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789042954.263432:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+12:5595:x1875947242404864:12345-192.168.203.17@tcp:503:ll_cfg_requeue.0 Request processed in 221us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042954.263440:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 234 00000100:00100000:1.0:1789042954.290464:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042954.290947:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242404992 00000100:00100000:2.0:1789042954.290957:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242404992 00000100:00100000:2.0:1789042954.291119:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 235 00000100:00100000:2.0:1789042954.291130:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+12:5595:x1875947242404992:12345-192.168.203.17@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789042954.291148:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789042954.291166:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a58604200/0x99260d7389c05f9b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca67689e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042954.291194:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a58604200/0x99260d7389c05f9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67689e expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042954.291207:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a58604200/0x99260d7389c05f9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67689e expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042954.291228:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a58604200, rc 0) 00000100:00100000:2.0:1789042954.291284:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:5595:x1875947242404992:12345-192.168.203.17@tcp:101:ll_cfg_requeue.0 Request processed in 156us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042954.291291:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 235 00000100:00100000:1.0:1789042954.298722:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042954.304957:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242405120 00000100:00100000:2.0:1789042954.304971:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242405120 00000100:00100000:2.0:1789042954.305205:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 236 00000100:00100000:2.0:1789042954.305217:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:5595:x1875947242405120:12345-192.168.203.17@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789042954.305532:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:5595:x1875947242405120:12345-192.168.203.17@tcp:501:ll_cfg_requeue.0 Request processed in 297us (6800us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042954.305542:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 236 00000100:00100000:1.0:1789042954.308992:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042954.312745:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242405248 00000100:00100000:2.0:1789042954.312759:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242405248 00000100:00100000:0.0:1789042954.316213:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 237 00000100:00100000:0.0:1789042954.316227:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:5595:x1875947242405248:12345-192.168.203.17@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789042954.316540:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:5595:x1875947242405248:12345-192.168.203.17@tcp:503:ll_cfg_requeue.0 Request processed in 314us (7556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042954.316549:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 237 00010000:00010000:2.0:1789042954.611344:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789042954.674661:0:5844:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789042954.674669:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa06a7924a000 from 7 10000000:01000000:2.0:1789042954.674673:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789042954.674721:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a58605c00/0x99260d7389c05fa2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042954.674987:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a58605c00/0x99260d7389c05fa2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042954.675001:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a58605c00/0x99260d7389c05fa2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042954.675031:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267607936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789042954.675118:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042954.675188:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a464c7600 going to sleep for 11 seconds 00000100:00100000:3.0:1789042954.675274:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267607936 00000100:00100000:3.0:1789042954.675283:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267607936 00000100:00100000:3.0:1789042954.675346:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789042954.675356:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:5844:x1875947267607936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789042954.675369:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789042954.675384:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a6fc29c00/0x99260d7389c05fa9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05fa2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042954.675424:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a6fc29c00/0x99260d7389c05fa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05fa2 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042954.675436:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a6fc29c00/0x99260d7389c05fa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05fa2 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042954.675446:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc29c00, rc 0) 00000100:00100000:3.0:1789042954.675497:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:5844:x1875947267607936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042954.675504:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789042954.676188:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267607936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789042954.676206:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a58605c00/0x99260d7389c05fa2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05fa9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042954.676216:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a58605c00/0x99260d7389c05fa2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05fa9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042954.676279:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267608064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789042954.676312:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042954.676357:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a464c7600 going to sleep for 11 seconds 00000100:00100000:3.0:1789042954.676447:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267608064 00000100:00100000:3.0:1789042954.676453:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267608064 00000100:00100000:3.0:1789042954.676488:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789042954.676496:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:5844:x1875947267608064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789042954.676917:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:5844:x1875947267608064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 420us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042954.676925:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789042954.678438:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267608064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789042954.678491:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267608192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789042954.678598:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042954.678637:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a464c7600 going to sleep for 11 seconds 00000100:00100000:3.0:1789042954.678813:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267608192 00000100:00100000:3.0:1789042954.678820:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267608192 00000100:00100000:3.0:1789042954.678918:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789042954.678929:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:5844:x1875947267608192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789042954.679149:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:5844:x1875947267608192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 222us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042954.679157:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789042954.679237:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267608192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789042954.684276:0:11263:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789042954.684578:0:5844:0:(obd_config.c:2243:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789042954.684600:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789042954.684610:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a58605c00/0x99260d7389c05fa2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05fa9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042954.684622:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a58605c00/0x99260d7389c05fa2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05fa9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789042954.684815:0:5844:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789042954.684817:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa06a7924c000 from 7 10000000:01000000:1.0:1789042954.684820:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789042954.684856:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41687e00/0x99260d7389c05fb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042954.684865:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a41687e00/0x99260d7389c05fb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042954.684876:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a41687e00/0x99260d7389c05fb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042954.684900:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f33b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267608320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789042954.684956:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042954.684991:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa069411efe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789042954.685372:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267608320 00000100:00100000:2.0:1789042954.685381:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267608320 00000100:00100000:2.0:1789042954.685433:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789042954.685443:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:5844:x1875947267608320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789042954.685456:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789042954.685469:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a58605200/0x99260d7389c05fb7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05fb0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042954.685494:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a58605200/0x99260d7389c05fb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05fb0 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042954.685534:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a58605200/0x99260d7389c05fb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05fb0 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042954.685544:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a58605200, rc 0) 00000100:00100000:2.0:1789042954.685600:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:5844:x1875947267608320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042954.685787:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789042954.688075:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f33b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267608320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789042954.688107:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a41687e00/0x99260d7389c05fb0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05fb7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042954.688121:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a41687e00/0x99260d7389c05fb0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05fb7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042954.688208:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f33b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267608448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789042954.688268:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042954.688302:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa069411efe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789042954.688422:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267608448 00000100:00100000:3.0:1789042954.688430:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267608448 00000100:00100000:3.0:1789042954.688487:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789042954.688498:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:5844:x1875947267608448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789042954.688938:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:5844:x1875947267608448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 440us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042954.688947:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789042954.689674:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f33b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267608448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789042954.689720:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f33b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267608576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789042954.689768:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042954.689803:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa069411efe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789042954.689862:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267608576 00000100:00100000:2.0:1789042954.689869:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267608576 00000100:00100000:2.0:1789042954.689912:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1789042954.689921:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:5844:x1875947267608576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789042954.690097:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:5844:x1875947267608576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 177us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042954.690104:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789042954.690464:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f33b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267608576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789042954.695052:0:11264:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789042954.695570:0:5844:0:(obd_config.c:2243:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789042954.695600:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789042954.695612:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41687e00/0x99260d7389c05fb0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05fb7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042954.695625:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a41687e00/0x99260d7389c05fb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05fb7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789042954.695637:0:5844:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789042954.695639:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa06a52b8e800 from 7 10000000:01000000:1.0:1789042954.695642:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789042954.695680:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41687c00/0x99260d7389c05fbe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042954.695689:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a41687c00/0x99260d7389c05fbe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042954.695699:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a41687c00/0x99260d7389c05fbe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042954.695726:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f33b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267608704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789042954.695790:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042954.695866:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa069411efe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789042954.695902:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267608704 00000100:00100000:3.0:1789042954.695909:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267608704 00000100:00100000:3.0:1789042954.695951:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789042954.695961:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:5844:x1875947267608704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789042954.695973:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789042954.695986:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c05fc5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c05fbe expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042954.696009:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c05fc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c05fbe expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042954.696020:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c05fc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05fbe expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042954.696029:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc29e00, rc 0) 00000100:00100000:3.0:1789042954.696109:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:5844:x1875947267608704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042954.696116:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1789042954.696182:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f33b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267608704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789042954.696197:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a41687c00/0x99260d7389c05fbe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05fc5 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042954.696437:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a41687c00/0x99260d7389c05fbe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05fc5 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042954.696486:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f33b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267608832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789042954.696511:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042954.696628:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa069411efe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789042954.696661:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267608832 00000100:00100000:3.0:1789042954.696665:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267608832 00000100:00100000:3.0:1789042954.696720:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789042954.696728:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:5844:x1875947267608832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789042954.696964:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:5844:x1875947267608832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042954.696971:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789042954.697023:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f33b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267608832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789042954.697066:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267608960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789042954.697109:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042954.697138:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a464c7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789042954.697156:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267608960 00000100:00100000:3.0:1789042954.697161:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267608960 00000100:00100000:3.0:1789042954.697222:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789042954.697229:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:5844:x1875947267608960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789042954.697411:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:5844:x1875947267608960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 182us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042954.697419:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1789042954.697482:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267608960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789042954.700771:0:11265:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789042954.700992:0:5844:0:(obd_config.c:2243:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789042954.701020:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789042954.701031:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41687c00/0x99260d7389c05fbe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05fc5 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042954.701045:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a41687c00/0x99260d7389c05fbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05fc5 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042955.513863:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267609344:0@lo:400:kworker.0 00000100:00100000:2.0:1789042955.513932:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042955.513998:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789042955.514005:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267609472:0@lo:400:kworker.0 00000100:00100000:2.0:1789042955.514031:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042955.514069:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267609344 00000100:00100000:2.0:1789042955.514077:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267609344 00000100:00100000:2.0:1789042955.514129:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789042955.514137:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267609344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789042955.514182:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267609344:12345-0@lo:400:kworker.0 Request processed in 46us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042955.514190:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:2.0:1789042955.514215:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789042955.514248:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267609344:0@lo:400:kworker.0 00000100:00100000:1.0:1789042955.514384:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875947267609216:0@lo:400:kworker.0 00000100:00100000:1.0:1789042955.514415:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042955.514444:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267609728:0@lo:400:kworker.0 00000100:00100000:1.0:1789042955.514464:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042955.514482:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789042955.514487:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267609088:0@lo:400:kworker.0 00000100:00100000:1.0:1789042955.514537:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042955.514558:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875947267609600:0@lo:400:kworker.0 00000100:00100000:1.0:1789042955.514578:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042955.514662:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267609472 00000100:00100000:0.0:1789042955.514668:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267609472 00000100:00100000:0.0:1789042955.514706:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267609728 00000100:00100000:0.0:1789042955.514709:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267609728 00000100:00100000:0.0:1789042955.514735:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789042955.514742:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267609472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789042955.514783:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267609472:12345-0@lo:400:kworker.0 Request processed in 42us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042955.514790:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789042955.514828:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789042955.514834:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f33aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267609728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789042955.514868:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f33aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267609728:12345-0@lo:400:kworker.0 Request processed in 35us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042955.514875:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789042955.514894:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267609216 00000100:00100000:0.0:1789042955.514897:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267609216 00000100:00100000:0.0:1789042955.514916:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267609600 00000100:00100000:0.0:1789042955.514918:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267609600 00000100:00100000:0.0:1789042955.514934:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789042955.514940:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875947267609216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789042955.514967:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875947267609216:12345-0@lo:400:kworker.0 Request processed in 27us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042955.514974:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789042955.514985:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789042955.514990:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875947267609600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789042955.515016:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875947267609600:12345-0@lo:400:kworker.0 Request processed in 26us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042955.515022:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789042955.515059:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875947267609600:0@lo:400:kworker.0 00000100:00100000:0.0:1789042955.515070:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875947267609216:0@lo:400:kworker.0 00010000:00080000:0.0:1789042955.515082:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7a8b7b80 x1875947267609728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042955.515092:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267609728:0@lo:400:kworker.0 00010000:00080000:0.0:1789042955.515122:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a6f1e3480 x1875947267609472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042955.515138:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267609472:0@lo:400:kworker.0 00000100:00080000:1.0:1789042955.515264:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789042955.515268:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789042955.515270:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789042955.516316:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267609088 00000100:00100000:3.0:1789042955.516337:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267609088 00000100:00100000:3.0:1789042955.516395:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789042955.516404:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267609088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042955.516482:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267609088:12345-0@lo:400:kworker.0 Request processed in 80us (1969us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042955.516489:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789042955.519850:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267609088:0@lo:400:kworker.0 00010000:00010000:3.0:1789042955.645219:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789042956.020346:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267609856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789042956.020419:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042956.020548:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267609856 00000100:00100000:3.0:1789042956.020557:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267609856 00000100:00100000:3.0:1789042956.020606:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789042956.020616:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a520c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267609856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789042956.020651:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789042956.020699:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a520c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267609856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042956.020716:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1789042956.020766:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a46ff1f80 x1875947267609856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042972 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042956.020786:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267609856:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1789042956.459430:0:11372:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1789042956.513430:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042956.513490:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042956.513548:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042956.513630:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242405376 00000100:00100000:0.0:1789042956.513641:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242405376 00000100:00100000:0.0:1789042956.513700:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 248 00000100:00100000:0.0:1789042956.513716:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2352:x1875947242405376:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1789042956.513791:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2352:x1875947242405376:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 82us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042956.513805:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 248 00000100:00100000:0.0:1789042956.513844:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242405632 00000100:00100000:0.0:1789042956.513848:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242405632 00000100:00100000:0.0:1789042956.513880:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242405504 00000100:00100000:0.0:1789042956.513883:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242405504 00000100:00100000:0.0:1789042956.513904:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 99 00000100:00100000:0.0:1789042956.513911:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f33ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2352:x1875947242405632:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1789042956.513940:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f33ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2352:x1875947242405632:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 30us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042956.513946:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 99 00000100:00100000:0.0:1789042956.513957:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 100 00000100:00100000:0.0:1789042956.513963:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f33b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2352:x1875947242405504:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1789042956.513986:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f33b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2352:x1875947242405504:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 24us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042956.514006:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 100 00000100:00080000:0.0:1789042956.514107:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789042956.659608:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789042957.561013:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789042957.561036:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a520c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267609984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789042957.561104:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042957.561577:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267609984 00000100:00100000:0.0:1789042957.561586:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267609984 00000100:00100000:0.0:1789042957.561654:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789042957.561664:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267609984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789042957.561697:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789042957.561762:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267609984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042957.561769:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1789042957.562004:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789042957.562074:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a520c0000 x1875947267609984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042973 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042957.562094:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a520c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267609984:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789042957.682979:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789042958.706865:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789042959.731021:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789042960.394739:0:11471:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 08:22:39 (1789042959) === 00000100:00100000:3.0:1789042960.597644:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042960.597700:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042960.597758:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242405760 00000100:00100000:0.0:1789042960.597774:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242405760 00000100:00100000:0.0:1789042960.597893:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 14 00000100:00100000:0.0:1789042960.597907:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2350:x1875947242405760:12345-192.168.203.17@tcp:41:mkdir.0 00000004:00000024:0.0:1789042960.597950:0:5846:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789042960.598354:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2350:x1875947242405760:12345-192.168.203.17@tcp:41:mkdir.0 Request processed in 450us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042960.598362:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 14 00000100:00100000:2.0:1789042960.598851:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242405888 00000100:00100000:2.0:1789042960.598857:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242405888 00000100:00100000:2.0:1789042960.598888:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 0 00000100:00100000:2.0:1789042960.598896:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:9679:x1875947242405888:12345-192.168.203.17@tcp:700:mkdir.0 00000100:00100000:2.0:1789042960.598936:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:9679:x1875947242405888:12345-192.168.203.17@tcp:700:mkdir.0 Request processed in 41us (1235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042960.598943:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 0 00000100:00080000:1.0:1789042960.600026:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789042960.601614:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042960.601720:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242406144 00000100:00100000:2.0:1789042960.601733:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242406144 00000100:00100000:2.0:1789042960.601823:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 15 00000100:00100000:2.0:1789042960.601833:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a520c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:9679:x1875947242406144:12345-192.168.203.17@tcp:36:mkdir.0 00010000:00010000:2.0:1789042960.601896:0:6714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789042960.601965:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c05ead lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676820 expref: 6 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.601986:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a55221d00) 00010000:00010000:2.0:1789042960.601998:0:6714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789042960.602316:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605400/0x99260d7389c05fcc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.602331:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605400/0x99260d7389c05fcc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.602340:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605400/0x99260d7389c05fcc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.602366:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604600/0x99260d7389c05fd3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.602375:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604600/0x99260d7389c05fd3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.602386:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604600/0x99260d7389c05fd3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789042960.603565:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789042960.603578:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605400/0x99260d7389c05fcc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.605405:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605400/0x99260d7389c05fcc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.605442:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605400/0x99260d7389c05fcc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.605449:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a58605400 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789042960.605453:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605400/0x99260d7389c05fcc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.605463:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605400/0x99260d7389c05fcc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.605479:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a457d3300) 00010000:00010000:2.0:1789042960.605482:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789042960.605487:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605400/0x99260d7389c05fcc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.605494:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605400/0x99260d7389c05fcc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789042960.605540:0:6714:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002ed06af reply state 0000000038314610 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604600/0x99260d7389c05fd3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042960.605551:0:6714:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789042960.605667:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a520c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:9679:x1875947242406144:12345-192.168.203.17@tcp:36:mkdir.0 Request processed in 3830us (4060us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789042960.605676:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 15 00010000:00010000:0.0:1789042960.609433:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604600/0x99260d7389c05fd3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.609450:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604600/0x99260d7389c05fd3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.609458:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604600/0x99260d7389c05fd3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.609481:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a58604600 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789042960.609485:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604600/0x99260d7389c05fd3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.609494:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604600/0x99260d7389c05fd3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.609510:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffffa06a457d3f00) 00010000:00010000:0.0:1789042960.609534:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789042960.609540:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604600/0x99260d7389c05fd3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.609547:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604600/0x99260d7389c05fd3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042960.626785:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267610496:0@lo:400:kworker.0 00000100:00100000:0.0:1789042960.626846:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267610112:0@lo:400:kworker.0 00000100:00100000:2.0:1789042960.626852:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042960.626884:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042960.626905:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875947267610624:0@lo:400:kworker.0 00000100:00100000:2.0:1789042960.626909:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789042960.626914:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875947267610368:0@lo:400:kworker.0 00000100:00100000:0.0:1789042960.626942:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042960.627009:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267610624 00000100:00100000:3.0:1789042960.627016:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267610624 00000100:00100000:3.0:1789042960.627070:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789042960.627080:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a520c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875947267610624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789042960.627156:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875947267610240:0@lo:400:kworker.0 00000100:00100000:2.0:1789042960.627188:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267610496 00000100:00100000:2.0:1789042960.627192:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267610496 00000100:00100000:2.0:1789042960.627226:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789042960.627236:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267610496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042960.628073:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a520c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875947267610624:12345-0@lo:400:kworker.0 Request processed in 992us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042960.628084:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789042960.628332:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042960.628368:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267610752:0@lo:400:kworker.0 00000100:00100000:1.0:1789042960.628395:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042960.628440:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267610112 00000100:00100000:1.0:1789042960.628446:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267610112 00000100:00100000:1.0:1789042960.628481:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789042960.628489:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3312:x1875947267610112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789042960.628540:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3312:x1875947267610112:12345-0@lo:400:kworker.0 Request processed in 52us (1655us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042960.628547:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789042960.628572:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267610752 00000100:00100000:1.0:1789042960.628577:0:8215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267610752 00000100:00100000:1.0:1789042960.628601:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789042960.628608:0:8215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f33b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267610752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789042960.628641:0:8215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f33b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267610752:12345-0@lo:400:kworker.0 Request processed in 33us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042960.628647:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1789042960.628669:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789042960.628673:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789042960.628675:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789042960.628699:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a6f1e3b80 x1875947267610752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789042960.628711:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267610752:0@lo:400:kworker.0 00000100:00100000:3.0:1789042960.628886:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267610240 00000100:00100000:3.0:1789042960.628902:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267610240 00000100:00100000:3.0:1789042960.628936:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789042960.628943:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875947267610240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042960.628989:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875947267610240:12345-0@lo:400:kworker.0 Request processed in 47us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042960.629010:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789042960.629193:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875947267610240:0@lo:400:kworker.0 00000100:00100000:2.0:1789042960.629589:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267610496:12345-0@lo:400:kworker.0 Request processed in 2353us (2735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042960.629597:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789042960.629625:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789042960.629664:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a6f1e1500 x1875947267610496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042960.629673:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267610496:0@lo:400:kworker.0 00000100:00100000:3.0:1789042960.629845:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267610368 00000100:00100000:3.0:1789042960.629850:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267610368 00000100:00100000:3.0:1789042960.629891:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789042960.629899:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875947267610368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042960.629940:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875947267610368:12345-0@lo:400:kworker.0 Request processed in 41us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042960.629946:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1789042960.630003:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789042960.630058:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875947267610368:0@lo:400:kworker.0 00000100:00100000:1.0:1789042960.630983:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875947267610624:0@lo:400:kworker.0 00000100:00100000:1.0:1789042960.631020:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267610112:0@lo:400:kworker.0 00000100:00100000:0.0:1789042960.654944:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042960.655126:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242406272 00000100:00100000:3.0:1789042960.655137:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242406272 00000100:00100000:3.0:1789042960.655194:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 16 00000100:00100000:3.0:1789042960.655204:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a520c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:9680:x1875947242406272:12345-192.168.203.17@tcp:101:chmod.0 00010000:00010000:3.0:1789042960.655225:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789042960.655249:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c05fda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca6768a5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.655322:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c05fe1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.655335:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c05fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.655349:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c05fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789042960.655381:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789042960.655385:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789042960.655431:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c05fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.655472:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c05fda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768a5 expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.655491:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c05fe1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768a5 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.655499:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a55d80000) 00010000:00010000:3.0:1789042960.655501:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789042960.655504:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc28400, rc 0) 00000100:00100000:3.0:1789042960.655607:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a520c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:9680:x1875947242406272:12345-192.168.203.17@tcp:101:chmod.0 Request processed in 404us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042960.655613:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 16 00000100:00100000:3.0:1789042960.657965:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042960.663222:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242406528 00000100:00100000:0.0:1789042960.663240:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242406528 00000100:00100000:2.0:1789042960.672508:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 17 00000100:00100000:2.0:1789042960.672541:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:9680:x1875947242406528:12345-192.168.203.17@tcp:36:chmod.0 00010000:00010000:2.0:1789042960.672597:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789042960.672625:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c05fe1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768a5 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.672646:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a55d80000) 00010000:00010000:2.0:1789042960.672657:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789042960.672681:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605400/0x99260d7389c05fe8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.672693:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605400/0x99260d7389c05fe8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.672721:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605400/0x99260d7389c05fe8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789042960.673043:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002837a3d2 reply state 00000000a06c9ecf transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605400/0x99260d7389c05fe8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042960.673053:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789042960.673060:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789042960.673143:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:9680:x1875947242406528:12345-192.168.203.17@tcp:36:chmod.0 Request processed in 605us (15184us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789042960.673149:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 17 00010000:00010000:3.0:1789042960.677742:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605400/0x99260d7389c05fe8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.677758:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605400/0x99260d7389c05fe8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.677765:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605400/0x99260d7389c05fe8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.677772:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a58605400 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789042960.677777:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605400/0x99260d7389c05fe8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.677786:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605400/0x99260d7389c05fe8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.677817:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a457d3300) 00010000:00010000:3.0:1789042960.677820:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789042960.677825:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605400/0x99260d7389c05fe8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.677832:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605400/0x99260d7389c05fe8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042960.708748:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042960.708915:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242406656 00000100:00100000:0.0:1789042960.708930:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242406656 00000100:00100000:0.0:1789042960.709013:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 18 00000100:00100000:0.0:1789042960.709022:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:9681:x1875947242406656:12345-192.168.203.17@tcp:101:chown.0 00010000:00010000:0.0:1789042960.709044:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789042960.709067:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c05fef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca6768ac expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.709155:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40030400/0x99260d7389c05ff6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.709170:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40030400/0x99260d7389c05ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.709183:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40030400/0x99260d7389c05ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789042960.709216:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789042960.709221:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789042960.709276:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40030400/0x99260d7389c05ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.709315:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c05fef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768ac expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.709334:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40030400/0x99260d7389c05ff6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768ac expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.709347:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a55221000) 00010000:00010000:0.0:1789042960.709349:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789042960.709353:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a40030400, rc 0) 00000100:00100000:0.0:1789042960.709430:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:9681:x1875947242406656:12345-192.168.203.17@tcp:101:chown.0 Request processed in 408us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042960.709437:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 18 00000100:00100000:2.0:1789042960.717191:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042960.717319:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242406784 00000100:00100000:3.0:1789042960.717333:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242406784 00000100:00100000:3.0:1789042960.717414:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 19 00000100:00100000:3.0:1789042960.717660:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:9681:x1875947242406784:12345-192.168.203.17@tcp:101:chown.0 00010000:00010000:3.0:1789042960.717691:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789042960.717717:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c05ffd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca6768b3 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.717821:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06004 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.717839:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06004 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.717853:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06004 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.717871:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c0600b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.717879:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c0600b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.717902:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c0600b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.718025:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06012 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.718033:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06012 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.718040:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06012 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789042960.718191:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789042960.718196:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789042960.718224:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06012 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.718238:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06004 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.718246:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06004 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.718254:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06004 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.718260:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc29200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789042960.718265:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06004 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.718274:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06004 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.718303:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a55221000) 00010000:00010000:3.0:1789042960.718307:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789042960.718313:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06004 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.718321:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06004 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.718338:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c0600b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.718344:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c0600b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.718350:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c0600b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.718355:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc28a00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789042960.718358:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c0600b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.718365:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c0600b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.718372:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffffa06a55d80500) 00010000:00010000:3.0:1789042960.718375:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789042960.718378:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c0600b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.718384:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c0600b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.718865:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c05ffd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768b3 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.718882:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06012 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768b3 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.718891:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa06a55d80d00) 00010000:00010000:3.0:1789042960.718893:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789042960.718896:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc28800, rc 0) 00000100:00100000:3.0:1789042960.719168:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+9:9681:x1875947242406784:12345-192.168.203.17@tcp:101:chown.0 Request processed in 1740us (1989us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042960.719178:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 19 00000100:00100000:2.0:1789042960.727053:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042960.727173:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242407040 00000100:00100000:0.0:1789042960.727186:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242407040 00000100:00100000:0.0:1789042960.727274:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 20 00000100:00100000:0.0:1789042960.727287:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+9:9681:x1875947242407040:12345-192.168.203.17@tcp:36:chown.0 00010000:00010000:0.0:1789042960.727370:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789042960.729877:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06012 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768b3 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.729912:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa06a55d80d00) 00010000:00010000:0.0:1789042960.729929:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789042960.729977:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06019 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.729994:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06019 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.730008:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06019 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.756357:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789042960.802975:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1789042960.803087:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4a5ddc9 reply state 0000000067cbd265 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06019 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042960.803103:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789042960.803123:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:0.0:1789042960.803259:0:5847:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1789042960.803284:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:9681:x1875947242407040:12345-192.168.203.17@tcp:36:chown.0 Request processed in 75994us (76240us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789042960.803305:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 20 00010000:00010000:1.0:1789042960.804055:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06019 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042960.804069:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06019 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042960.804078:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06019 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042960.804086:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a40031000 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789042960.804091:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06019 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042960.804100:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06019 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042960.804119:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa06a55221a00) 00010000:00010000:1.0:1789042960.804123:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789042960.804129:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06019 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042960.804137:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06019 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042960.820942:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042960.821570:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242407168 00000100:00100000:3.0:1789042960.821584:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242407168 00000100:00100000:3.0:1789042960.821653:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 21 00000100:00100000:3.0:1789042960.821665:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:9682:x1875947242407168:12345-192.168.203.17@tcp:101:touch.500 00010000:00010000:3.0:1789042960.821698:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789042960.821723:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06020 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca6768ba expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789042960.826576:0:5846:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4776us 00010000:00010000:0.0:1789042960.856249:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06027 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.856277:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06027 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.856314:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06027 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.856334:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c0602e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.856342:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c0602e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.856349:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c0602e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.856953:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06035 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.856966:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06035 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.856975:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06035 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789042960.857003:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789042960.857008:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789042960.857054:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06035 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.857068:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06027 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.857075:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06027 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.857094:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06027 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.857102:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a40031c00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789042960.857107:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06027 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.857117:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06027 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.857192:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a55221000) 00010000:00010000:0.0:1789042960.857195:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789042960.857202:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06027 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.857210:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06027 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.857225:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c0602e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.857232:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c0602e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.857238:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c0602e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.857244:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a40031a00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789042960.857247:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c0602e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.857263:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c0602e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.857271:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffffa06a55221e00) 00010000:00010000:0.0:1789042960.857273:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789042960.857277:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c0602e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.857283:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c0602e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.857341:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06020 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768ba expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.857360:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06035 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768ba expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.857368:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa06a55221c00) 00010000:00010000:0.0:1789042960.857370:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789042960.857373:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a40031000, rc 0) 00000100:00100000:0.0:1789042960.857476:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:9682:x1875947242407168:12345-192.168.203.17@tcp:101:touch.500 Request processed in 35812us (36548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042960.857487:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 21 00000100:00100000:0.0:1789042960.861849:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042960.862008:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242407424 00000100:00100000:3.0:1789042960.862021:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242407424 00000100:00100000:3.0:1789042960.862091:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 22 00000100:00100000:3.0:1789042960.862103:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942104380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:9682:x1875947242407424:12345-192.168.203.17@tcp:101:touch.500 00010000:00010000:3.0:1789042960.862139:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789042960.862183:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c0603c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca6768c1 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.862560:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06043 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.862579:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06043 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.862593:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06043 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.862608:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28e00/0x99260d7389c0604a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.862615:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28e00/0x99260d7389c0604a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.862622:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28e00/0x99260d7389c0604a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789042960.864452:0:6714:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1789042960.865053:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06051 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.865075:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06051 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.865087:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06051 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.865247:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06043 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.865269:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06043 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.865278:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06043 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.865286:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc29200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789042960.865301:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06043 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.865310:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06043 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.865325:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa06a55221c00) 00010000:00010000:3.0:1789042960.865328:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789042960.865333:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06043 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.865340:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06043 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789042960.865357:0:6714:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000278c43f9 reply state 00000000e9c6f2b5 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28e00/0x99260d7389c0604a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042960.865367:0:6714:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789042960.865413:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c0603c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768c1 expref: 10 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.865607:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06051 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768c1 expref: 9 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.865627:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa06a55d80600) 00010000:00010000:3.0:1789042960.865630:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789042960.865633:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc29000, rc 0) 00000100:00100000:3.0:1789042960.865725:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942104380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+10:9682:x1875947242407424:12345-192.168.203.17@tcp:101:touch.500 Request processed in 3624us (3889us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789042960.865734:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 22 00000100:00100000:2.0:1789042960.870788:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042960.871098:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242407680 00000100:00100000:0.0:1789042960.871112:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242407680 00000100:00100000:0.0:1789042960.871193:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 23 00000100:00100000:0.0:1789042960.871205:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42f41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+10:9682:x1875947242407680:12345-192.168.203.17@tcp:36:touch.500 00010000:00010000:0.0:1789042960.871312:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789042960.871346:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06051 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768c1 expref: 10 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.871370:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa06a55d80600) 00010000:00010000:0.0:1789042960.871383:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789042960.871686:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c0605f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042960.871706:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c0605f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042960.871726:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c0605f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789042960.871917:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c7642e17 reply state 00000000a985fa3f transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c0605f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042960.871929:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789042960.872053:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42f41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+11:9682:x1875947242407680:12345-192.168.203.17@tcp:36:touch.500 Request processed in 848us (1278us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789042960.872061:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 23 00010000:00010000:3.0:1789042960.874712:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28e00/0x99260d7389c0604a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.874733:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28e00/0x99260d7389c0604a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.874742:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28e00/0x99260d7389c0604a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.874748:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc28e00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789042960.874755:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28e00/0x99260d7389c0604a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.875084:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c0605f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.875095:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c0605f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.875102:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c0605f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.875108:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687000 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789042960.875111:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c0605f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.875120:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c0605f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.875149:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa06a55221700) 00010000:00010000:0.0:1789042960.875152:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789042960.875158:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c0605f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.875166:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c0605f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.876447:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28e00/0x99260d7389c0604a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.876465:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc51bb70 (ffffa06a55d80500) 00010000:00010000:3.0:1789042960.876469:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789042960.876474:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28e00/0x99260d7389c0604a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.876482:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28e00/0x99260d7389c0604a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042960.882465:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042960.882695:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242407808 00000100:00100000:0.0:1789042960.882724:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242407808 00000100:00100000:0.0:1789042960.882799:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 24 00000100:00100000:0.0:1789042960.882811:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+9:9682:x1875947242407808:12345-192.168.203.17@tcp:101:touch.500 00010000:00010000:0.0:1789042960.882845:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789042960.882873:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06066 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca6768c8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.882951:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06066 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768c8 expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.882968:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06066 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768c8 expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.882990:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa06a55221700) 00010000:00010000:0.0:1789042960.882994:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789042960.882999:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a40031a00, rc 0) 00000100:00100000:0.0:1789042960.883080:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+10:9682:x1875947242407808:12345-192.168.203.17@tcp:101:touch.500 Request processed in 271us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042960.883089:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 24 00000100:00100000:2.0:1789042960.886683:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042960.887043:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242407936 00000100:00100000:1.0:1789042960.887056:0:8215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242407936 00000100:00100000:1.0:1789042960.887301:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 16 00000100:00100000:1.0:1789042960.887311:0:8215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42f40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2348:x1875947242407936:12345-192.168.203.17@tcp:8:touch.500 00010000:00080000:1.0:1789042960.887355:0:8215:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3fb32839-ebfd-4c0f-90e4-f036c86704df@192.168.203.17@tcp t0 exp 0000000000000000 cur 303 last 0 00000020:00000080:1.0:1789042960.887396:0:8215:0:(genops.c:1393:class_connect()) connect: client 3fb32839-ebfd-4c0f-90e4-f036c86704df, cookie 0x99260d7389c0606d 00002000:00100000:1.0:1789042960.887412:0:8215:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3fb32839-ebfd-4c0f-90e4-f036c86704df/ffffa06942b66800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789042960.887503:0:8215:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789042960.887902:0:8215:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789042960.887946:0:8215:0:(import.c:65:import_set_state_nolock()) ffffa06942b65800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789042960.888031:0:8215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42f40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2348:x1875947242407936:12345-192.168.203.17@tcp:8:touch.500 Request processed in 719us (1362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042960.888040:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 16 00000100:00100000:2.0:1789042960.890132:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042960.890507:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242408064 00000100:00100000:0.0:1789042960.890539:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242408064 00000100:00100000:0.0:1789042960.890624:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 17 00000100:00100000:0.0:1789042960.890636:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42f43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:0:x1875947242408064:12345-192.168.203.17@tcp:2:touch.500 00000100:00080000:2.0:1789042960.891576:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1789042960.933097:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:1.0:1789042960.933341:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3fb32839-ebfd-4c0f-90e4-f036c86704df 00000100:00100000:2.0:1789042960.939474:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42f43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:0:x1875947242408064:12345-192.168.203.17@tcp:2:touch.500 Request processed in 48823us (49338us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789042960.939491:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 17 00000100:00100000:2.0:1789042960.945434:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042960.945636:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242408320 00000100:00100000:3.0:1789042960.945650:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242408320 00000100:00100000:3.0:1789042960.945728:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 2 00000100:00100000:3.0:1789042960.945738:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+10:9682:x1875947242408320:12345-192.168.203.17@tcp:35:touch.500 00000100:00100000:3.0:1789042960.946665:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+11:9682:x1875947242408320:12345-192.168.203.17@tcp:35:touch.500 Request processed in 923us (1247us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789042960.946676:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 2 00000100:00100000:0.0:1789042960.963022:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042960.963133:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242408448 00000100:00100000:1.0:1789042960.963164:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242408448 00000100:00100000:1.0:1789042960.963309:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 25 00000100:00100000:1.0:1789042960.963323:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942105880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+11:9683:x1875947242408448:12345-192.168.203.17@tcp:101:rm.0 00010000:00010000:1.0:1789042960.963356:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789042960.963383:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687600/0x99260d7389c06074 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca6768cf expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042960.963469:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0607b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042960.963486:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0607b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042960.963501:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0607b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789042960.963589:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789042960.963594:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789042960.963639:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0607b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042960.963673:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687600/0x99260d7389c06074 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768cf expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042960.963694:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0607b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768cf expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042960.963703:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa06a55221c00) 00010000:00010000:1.0:1789042960.963706:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789042960.963711:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41686e00, rc 0) 00000100:00100000:1.0:1789042960.963913:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942105880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+12:9683:x1875947242408448:12345-192.168.203.17@tcp:101:rm.0 Request processed in 593us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042960.963922:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 25 00000100:00100000:2.0:1789042960.966398:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042960.966777:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242408704 00000100:00100000:0.0:1789042960.966791:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242408704 00000100:00100000:0.0:1789042960.966891:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 26 00000100:00100000:0.0:1789042960.966905:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42f41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+12:9683:x1875947242408704:12345-192.168.203.17@tcp:101:rm.0 00010000:00010000:0.0:1789042960.966948:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789042960.966975:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06082 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca6768d6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789042960.967092:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789042960.967308:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06082 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768d6 expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.967326:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a55221000) 00010000:00010000:0.0:1789042960.967329:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789042960.967336:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06082 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768d6 expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.967351:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a40031c00, rc 0) 00000100:00100000:0.0:1789042960.967425:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42f41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+13:9683:x1875947242408704:12345-192.168.203.17@tcp:101:rm.0 Request processed in 523us (1040us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1789042960.967433:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 26 00000100:00100000:3.0:1789042960.971501:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042960.971665:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242408832 00000100:00100000:1.0:1789042960.971680:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242408832 00000100:00100000:1.0:1789042960.971754:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 3 00000100:00100000:1.0:1789042960.971776:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+13:9683:x1875947242408832:12345-192.168.203.17@tcp:37:rm.0 00000100:00100000:1.0:1789042960.976284:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+13:9683:x1875947242408832:12345-192.168.203.17@tcp:37:rm.0 Request processed in 4505us (4782us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042960.976310:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 3 00000100:00100000:0.0:1789042960.980285:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042960.980388:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242409088 00000100:00100000:3.0:1789042960.980403:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242409088 00000100:00100000:3.0:1789042960.980506:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 4 00000100:00100000:3.0:1789042960.980548:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a50c21850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+13:9683:x1875947242409088:12345-192.168.203.17@tcp:35:rm.0 00000100:00100000:3.0:1789042960.980866:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a50c21850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+14:9683:x1875947242409088:12345-192.168.203.17@tcp:35:rm.0 Request processed in 320us (594us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789042960.980874:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 4 00000100:00100000:2.0:1789042960.983938:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042960.984044:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242409344 00000100:00100000:0.0:1789042960.984059:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242409344 00000100:00100000:0.0:1789042960.984159:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 27 00000100:00100000:0.0:1789042960.984172:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42f42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+14:9683:x1875947242409344:12345-192.168.203.17@tcp:101:rm.0 00010000:00010000:0.0:1789042960.984206:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789042960.984234:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06090 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca6768dd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.984363:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06097 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.984396:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06097 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.984411:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06097 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789042960.984426:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789042960.984629:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06090 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768dd expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.984650:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06097 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768dd expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042960.984660:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa06a55221c00) 00010000:00010000:0.0:1789042960.984663:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789042960.984667:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a40031600, rc 0) 00000100:00100000:0.0:1789042960.984728:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42f42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+16:9683:x1875947242409344:12345-192.168.203.17@tcp:101:rm.0 Request processed in 560us (805us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789042960.984735:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 27 00000100:00100000:2.0:1789042960.987063:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042960.987178:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242409472 00000100:00100000:1.0:1789042960.987190:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242409472 00000100:00100000:1.0:1789042960.987261:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 28 00000100:00100000:1.0:1789042960.987273:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42f40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+16:9683:x1875947242409472:12345-192.168.203.17@tcp:41:rm.0 00000004:00000024:1.0:1789042960.987358:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1789042960.987443:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42f40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+16:9683:x1875947242409472:12345-192.168.203.17@tcp:41:rm.0 Request processed in 172us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042960.987451:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 28 00000100:00100000:1.0:1789042960.989475:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042960.989690:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242409600 00000100:00100000:2.0:1789042960.989702:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242409600 00000100:00100000:2.0:1789042960.989780:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 29 00000100:00100000:2.0:1789042960.989792:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+16:9683:x1875947242409600:12345-192.168.203.17@tcp:101:rm.0 00010000:00010000:2.0:1789042960.989817:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789042960.989844:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605400/0x99260d7389c060a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca6768e4 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.989927:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604600/0x99260d7389c060ac lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.989945:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604600/0x99260d7389c060ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.989960:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604600/0x99260d7389c060ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.989976:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604e00/0x99260d7389c060b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.989984:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604e00/0x99260d7389c060b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.989991:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604e00/0x99260d7389c060b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.990147:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c060ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.990157:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c060ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.990175:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c060ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789042960.990211:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789042960.990216:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789042960.990240:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c060ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.990253:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c060ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.990263:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604600/0x99260d7389c060ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.990271:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604600/0x99260d7389c060ac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.990279:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604600/0x99260d7389c060ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.990295:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a58604600 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789042960.990300:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604600/0x99260d7389c060ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.990309:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604600/0x99260d7389c060ac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.990322:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa06a55221c00) 00010000:00010000:2.0:1789042960.990326:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789042960.990331:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604600/0x99260d7389c060ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.990350:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604600/0x99260d7389c060ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.990368:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604e00/0x99260d7389c060b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.990374:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604e00/0x99260d7389c060b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.990381:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604e00/0x99260d7389c060b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.990386:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a58604e00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789042960.990389:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604e00/0x99260d7389c060b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.990396:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604e00/0x99260d7389c060b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.990404:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc51bb70 (ffffa06a457d3200) 00010000:00010000:2.0:1789042960.990407:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789042960.990409:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604e00/0x99260d7389c060b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.990415:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604e00/0x99260d7389c060b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.991058:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605400/0x99260d7389c060a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768e4 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.991081:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c060ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768e4 expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042960.991098:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa06a55221700) 00010000:00010000:2.0:1789042960.991100:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789042960.991104:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50978600, rc 0) 00000100:00100000:2.0:1789042960.991191:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+17:9683:x1875947242409600:12345-192.168.203.17@tcp:101:rm.0 Request processed in 1400us (1728us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042960.991200:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 29 00000100:00100000:2.0:1789042960.998148:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042960.998271:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242409856 00000100:00100000:3.0:1789042960.998285:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242409856 00000100:00100000:3.0:1789042960.998367:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 30 00000100:00100000:3.0:1789042960.998379:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+17:9683:x1875947242409856:12345-192.168.203.17@tcp:36:rm.0 00010000:00010000:3.0:1789042960.998451:0:6714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789042960.998486:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c060ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768e4 expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.998643:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06066 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768c8 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.998686:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa06a55221700) 00010000:00010000:3.0:1789042960.998708:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0607b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768cf expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.998717:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa06a55221c00) 00010000:00010000:3.0:1789042960.998721:0:6714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789042960.998748:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28e00/0x99260d7389c060c1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.998763:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28e00/0x99260d7389c060c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.998773:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28e00/0x99260d7389c060c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.998788:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c060c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.998795:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c060c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.998801:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c060c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.998980:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c060cf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.998989:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c060cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042960.999007:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c060cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789042961.000134:0:6714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1789042961.000149:0:6714:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 303956634137ns, next at 304956631200ns, rc = 0 00010000:00010000:3.0:1789042961.000231:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c060d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042961.000246:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c060d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042961.000256:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c060d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042961.000266:0:6714:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c060d6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042961.000274:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c060d6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042961.000281:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c060d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042961.000363:0:6714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789042961.000388:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c060cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042961.000396:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c060cf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042961.000403:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c060cf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042961.000417:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc29200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789042961.000423:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c060cf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042961.000431:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c060cf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042961.000445:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa06a55d80b00) 00010000:00010000:3.0:1789042961.000448:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789042961.000454:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c060cf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042961.000460:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c060cf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042961.000481:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28e00/0x99260d7389c060c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042961.000487:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28e00/0x99260d7389c060c1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042961.000494:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28e00/0x99260d7389c060c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042961.000499:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc28e00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789042961.000501:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28e00/0x99260d7389c060c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042961.000507:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28e00/0x99260d7389c060c1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042961.000578:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa06a55221c00) 00010000:00010000:3.0:1789042961.000580:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789042961.000584:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28e00/0x99260d7389c060c1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042961.000591:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28e00/0x99260d7389c060c1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789042961.000603:0:6714:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd15144e reply state 000000005848becd transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c060c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042961.000613:0:6714:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789042961.000727:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+16:9683:x1875947242409856:12345-192.168.203.17@tcp:36:rm.0 Request processed in 2344us (2585us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789042961.000737:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 30 00010000:00010000:3.0:1789042961.003564:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c060c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042961.003588:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c060c8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042961.003597:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c060c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042961.003604:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc28a00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789042961.003610:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c060c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042961.003619:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c060c8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042961.003661:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc51bb70 (ffffa06a55d80500) 00010000:00010000:3.0:1789042961.003664:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789042961.003671:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c060c8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042961.003679:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c060c8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042961.004352:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789042961.004363:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c060d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042961.004371:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc29000 already unused, calling callback (ffffffffc1470760) 00010000:00010000:2.0:1789042961.004375:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c060d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042961.004382:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c060d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042961.004394:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa06a55d80b00) 00010000:00010000:2.0:1789042961.004398:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789042961.004401:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c060d6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042961.004407:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c060d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042961.004427:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789042961.004428:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789042961.004430:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789042961.005153:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042961.005247:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242410112 00000100:00100000:1.0:1789042961.005260:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242410112 00000100:00100000:1.0:1789042961.005364:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 5 00000100:00100000:1.0:1789042961.005377:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942104e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+15:9683:x1875947242410112:12345-192.168.203.17@tcp:35:rm.0 00000100:00100000:1.0:1789042961.005720:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942104e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+16:9683:x1875947242410112:12345-192.168.203.17@tcp:35:rm.0 Request processed in 345us (575us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789042961.005729:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 5 00000100:00100000:0.0:1789042961.008738:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042961.008970:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242410368 00000100:00100000:2.0:1789042961.008984:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242410368 00000100:00100000:2.0:1789042961.009084:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 31 00000100:00100000:2.0:1789042961.009097:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942107100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+16:9683:x1875947242410368:12345-192.168.203.17@tcp:36:rm.0 00010000:00010000:2.0:1789042961.009171:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789042961.009207:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06097 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768dd expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042961.009232:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06035 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768ba expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042961.009244:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa06a55221c00) 00010000:00010000:2.0:1789042961.009261:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40030400/0x99260d7389c05ff6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768ac expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042961.009270:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a55221000) 00010000:00010000:2.0:1789042961.009277:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789042961.009320:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c060dd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042961.009336:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c060dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042961.009347:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c060dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042961.009361:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c060e4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042961.009368:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c060e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042961.009395:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c060e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042961.009739:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c060eb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042961.009749:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c060eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042961.009868:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c060eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789042961.010488:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789042961.010508:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c060eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042961.010550:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c060eb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042961.010558:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c060eb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042961.010565:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979400 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789042961.010570:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c060eb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042961.010579:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c060eb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042961.010591:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa06a457d3300) 00010000:00010000:2.0:1789042961.010594:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789042961.010605:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c060eb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042961.010613:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c060eb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042961.010635:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c060dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042961.010641:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c060dd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042961.010648:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c060dd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042961.010653:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979e00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789042961.010655:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c060dd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042961.010661:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c060dd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042961.010667:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a457d3200) 00010000:00010000:2.0:1789042961.010669:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789042961.010672:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c060dd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042961.010677:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c060dd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789042961.010686:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ff33eedc reply state 00000000c796f15f transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c060e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042961.010704:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789042961.011233:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942107100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+15:9683:x1875947242410368:12345-192.168.203.17@tcp:36:rm.0 Request processed in 2132us (2501us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789042961.011244:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 31 00010000:00010000:0.0:1789042961.020011:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c060e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042961.020035:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c060e4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042961.020044:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c060e4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042961.020071:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50978000 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789042961.020076:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c060e4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042961.020086:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c060e4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042961.020107:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffffa06a457d3d00) 00010000:00010000:0.0:1789042961.020110:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789042961.020116:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c060e4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042961.020124:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c060e4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042961.140372:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267610880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789042961.140467:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042961.140982:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267610880 00000100:00100000:3.0:1789042961.140994:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267610880 00000100:00100000:3.0:1789042961.158164:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789042961.158202:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942104000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267610880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789042961.158245:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789042961.158368:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942104000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267610880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 185us (17901us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042961.158377:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1789042961.158590:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a46ff1180 x1875947267610880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042977 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042961.158618:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267610880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789042961.613946:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042961.614066:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042961.614117:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042961.614175:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242410752 00000100:00100000:3.0:1789042961.614189:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242410752 00000100:00100000:3.0:1789042961.614294:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 104 00000100:00100000:3.0:1789042961.614307:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942107800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2351:x1875947242410752:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1789042961.614399:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942107800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2351:x1875947242410752:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 94us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042961.614407:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 104 00000100:00080000:0.0:1789042961.615355:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789042961.617991:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242410496 00000100:00100000:1.0:1789042961.618012:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242410496 00000100:00100000:1.0:1789042961.618126:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 250 00000100:00100000:1.0:1789042961.618140:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a472e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2351:x1875947242410496:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1789042961.618233:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a472e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2351:x1875947242410496:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 96us (4166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042961.618242:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 250 00000100:00100000:2.0:1789042961.624391:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242410624 00000100:00100000:2.0:1789042961.624422:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242410624 00000100:00100000:2.0:1789042961.624539:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 58 00000100:00100000:2.0:1789042961.624552:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942106680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2351:x1875947242410624:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1789042961.624658:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942106680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2351:x1875947242410624:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 107us (10726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042961.624667:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 58 00010000:00010000:2.0:1789042961.782726:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789042962.674995:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06942106300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267611008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789042962.675090:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042962.675338:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267611008 00000100:00100000:3.0:1789042962.675349:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267611008 00000100:00100000:3.0:1789042962.675440:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789042962.675452:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267611008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789042962.675539:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789042962.675630:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789042962.677590:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267611008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2130us (2489us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042962.677605:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1789042962.677951:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06942106300 x1875947267611008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042978 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042962.677989:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06942106300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267611008:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789042962.803733:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789042963.826728:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789042964.852235:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789042965.070865:0:11620:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:3.0:1789042965.747272:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875947267611264:0@lo:400:kworker.0 00000100:00100000:3.0:1789042965.747362:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042965.747830:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7fa3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267611776:0@lo:400:kworker.0 00000100:00100000:3.0:1789042965.747909:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042965.748082:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789042965.748096:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267611136:0@lo:400:kworker.0 00000100:00100000:3.0:1789042965.748140:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042965.748237:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7fa3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875947267611648:0@lo:400:kworker.0 00000100:00100000:3.0:1789042965.748274:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042965.748308:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7fa3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267611392:0@lo:400:kworker.0 00000100:00100000:3.0:1789042965.748333:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042965.748351:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789042965.748358:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7fa3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267611520:0@lo:400:kworker.0 00000100:00100000:3.0:1789042965.750979:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042965.751075:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267611264 00000100:00100000:3.0:1789042965.751086:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267611264 00000100:00100000:3.0:1789042965.751144:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267611648 00000100:00100000:3.0:1789042965.751148:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267611648 00000100:00100000:3.0:1789042965.751176:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267611392 00000100:00100000:3.0:1789042965.751179:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267611392 00000100:00100000:3.0:1789042965.751198:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789042965.751209:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7fa3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875947267611264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042965.751305:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7fa3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875947267611264:12345-0@lo:400:kworker.0 Request processed in 98us (3943us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042965.751313:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789042965.751330:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789042965.751337:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7fa3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875947267611648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042965.751365:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7fa3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875947267611648:12345-0@lo:400:kworker.0 Request processed in 29us (3091us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042965.751370:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789042965.751379:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789042965.751384:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7fa3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267611392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042965.751411:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7fa3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267611392:12345-0@lo:400:kworker.0 Request processed in 27us (3078us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042965.751416:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789042965.751433:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267611136 00000100:00100000:3.0:1789042965.751436:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267611136 00000100:00100000:3.0:1789042965.751460:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1789042965.751466:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a472e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267611136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042965.751581:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a472e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267611136:12345-0@lo:400:kworker.0 Request processed in 28us (3353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042965.751589:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00080000:3.0:1789042965.751624:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789042965.751738:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7fa3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267611392:0@lo:400:kworker.0 00000100:00100000:3.0:1789042965.751769:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267611136:0@lo:400:kworker.0 00000100:00100000:3.0:1789042965.751781:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7fa3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875947267611648:0@lo:400:kworker.0 00000100:00100000:3.0:1789042965.751806:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875947267611264:0@lo:400:kworker.0 00000100:00100000:0.0:1789042965.752057:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267611776 00000100:00100000:0.0:1789042965.752080:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267611776 00000100:00100000:0.0:1789042965.752140:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267611520 00000100:00100000:0.0:1789042965.752144:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267611520 00000100:00100000:0.0:1789042965.752183:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789042965.752193:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7fa3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267611776:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789042965.752271:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789042965.752276:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789042965.752455:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7fa3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267611776:12345-0@lo:400:kworker.0 Request processed in 263us (4545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042965.752465:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789042965.752482:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789042965.752489:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7fa3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267611520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789042965.752545:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7fa3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267611520:12345-0@lo:400:kworker.0 Request processed in 57us (1574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042965.752551:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1789042965.753670:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7fa3c700 x1875947267611520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042965.753688:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7fa3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267611520:0@lo:400:kworker.0 00010000:00080000:3.0:1789042965.753733:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7fa3f480 x1875947267611776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042965.753743:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7fa3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267611776:0@lo:400:kworker.0 00000001:00080000:0.0:1789042965.823996:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967305 is committed 00000001:00080000:0.0:1789042965.824026:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000001:00080000:0.0:1789042965.824035:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1789042965.824046:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1789042965.824298:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789042965.824318:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7fa3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267611904:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789042965.824384:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042965.824455:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267611904 00000100:00100000:0.0:1789042965.824468:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267611904 00000100:00100000:0.0:1789042965.824720:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789042965.824735:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267611904:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789042965.824774:0:6690:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1789042965.824822:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa2a111, atime: 0x6aa2a111, ctime: 0x6aa2a111, blocks: 0x1 00010000:00010000:0.0:1789042965.824832:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dc47374/0x99260d7389c060f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042965.824853:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=308s v=(0 0) 00010000:00010000:0.0:1789042965.824859:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789042965.824875:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dc47374/0x99260d7389c060f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042965.824897:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004dc47374/0x99260d7389c060f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042965.824910:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dc47374/0x99260d7389c060f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042965.824920:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004dc47374/0x99260d7389c060f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042965.824952:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789042965.826132:0:11175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789042965.826146:0:11175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004dc47374/0x99260d7389c060f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042965.826161:0:11175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a413a0600 already unused, calling callback (ffffffffc1470760) 00010000:00010000:2.0:1789042965.826166:0:11175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004dc47374/0x99260d7389c060f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042965.826193:0:11175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004dc47374/0x99260d7389c060f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042965.826219:0:11175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004dc47374/0x99260d7389c060f2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042965.826228:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004dc47374/0x99260d7389c060f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042965.826269:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789042965.826271:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789042965.826274:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789042965.827974:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1875947267611904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3233us (3580us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789042965.827990:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:1.0:1789042965.828313:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa06a7fa3f480/2, rc 0, transno 4294967300 00000100:00100000:1.0:1789042965.828323:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7fa3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267611904:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789042965.877003:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789042966.254820:0:11668:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffee0740e40 20000000:00000080:0.0:1789042966.254840:0:11668:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa06a42fe6000 uarg=0000000000000000 20000000:01000000:0.0:1789042966.254874:0:11668:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789042966.254880:0:11668:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789042966.254884:0:11668:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000100:00100000:0.0:1789042966.259070:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789042966.259091:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06942106d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267612032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789042966.259158:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042966.259308:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267612032 00000100:00100000:1.0:1789042966.259316:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267612032 00000100:00100000:1.0:1789042966.259368:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789042966.259379:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942106300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875947267612032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789042966.259413:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789042966.259457:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942106300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875947267612032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042966.259464:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789042966.259510:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06942106d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267612032:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1789042966.260766:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1789042966.271952:0:11668:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1789042966.295241:0:11668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1789042966.295309:0:11668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1789042966.295366:0:11668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1789042966.295383:0:11668:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789042966.295401:0:11668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa06a50978800/0x99260d7389c060f9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042966.295421:0:11668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a41686600/0x99260d7389c05f94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676897 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042966.295429:0:11668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a58604200/0x99260d7389c05f9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67689e expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042966.295436:0:11668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a6fc29c00/0x99260d7389c05fa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05fa2 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042966.295456:0:11668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a58605200/0x99260d7389c05fb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05fb0 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042966.295463:0:11668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c05fc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c05fbe expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042966.295470:0:11668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa06a50978800/0x99260d7389c060f9 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.297872:0:11668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c05fc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99260d7389c05fbe expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.297893:0:11668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c05fc5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99260d7389c05fbe expref: 18 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042966.297909:0:11668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a42f41180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1875947267612160:0@lo:104: 00000100:00100000:3.0:1789042966.297975:0:11668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789042966.298044:0:11668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a58605200/0x99260d7389c05fb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99260d7389c05fb0 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.298052:0:11668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa06a58605200/0x99260d7389c05fb7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99260d7389c05fb0 expref: 18 pid: 5841 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042966.298060:0:11668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7fa3e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1875947267612288:0@lo:104: 00000100:00100000:3.0:1789042966.298082:0:11668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042966.298128:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267612160 00000100:00100000:3.0:1789042966.298136:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267612160 00000100:00100000:3.0:1789042966.298171:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267612288 00000100:00100000:3.0:1789042966.298174:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267612288 00000100:00100000:3.0:1789042966.298188:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789042966.298196:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7fa3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+4:11668:x1875947267612160:12345-0@lo:104: 00010000:00010000:3.0:1789042966.298209:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffffa06a41687c00/0x99260d7389c05fbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05fc5 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.298267:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789042966.298273:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7fa3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+4:11668:x1875947267612160:12345-0@lo:104: Request processed in 78us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042966.298281:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789042966.298298:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789042966.298305:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7fa3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+3:11668:x1875947267612288:12345-0@lo:104: 00010000:00010000:3.0:1789042966.298313:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffffa06a41687e00/0x99260d7389c05fb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05fb7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.298345:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789042966.298349:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7fa3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+3:11668:x1875947267612288:12345-0@lo:104: Request processed in 46us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042966.299570:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1789042966.299603:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789042966.299611:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a41687c00/0x99260d7389c05fbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05fc5 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.299620:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687c00 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:3.0:1789042966.299624:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a41687c00/0x99260d7389c05fbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x99260d7389c05fc5 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.299647:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a41687c00/0x99260d7389c05fbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x99260d7389c05fc5 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789042966.299655:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a41687c00/0x99260d7389c05fbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x99260d7389c05fc5 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789042966.299660:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789042966.299697:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a41687c00/0x99260d7389c05fbe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05fc5 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.299703:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789042966.299727:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a41687c00/0x99260d7389c05fbe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05fc5 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.299734:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a41687c00/0x99260d7389c05fbe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05fc5 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.299748:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789042966.299751:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a41687e00/0x99260d7389c05fb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05fb7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.299756:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687e00 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:3.0:1789042966.299759:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a41687e00/0x99260d7389c05fb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x99260d7389c05fb7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.299766:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a41687e00/0x99260d7389c05fb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x99260d7389c05fb7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789042966.299772:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a41687e00/0x99260d7389c05fb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x99260d7389c05fb7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789042966.299784:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789042966.299799:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a41687e00/0x99260d7389c05fb0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05fb7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.299804:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789042966.299811:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a41687e00/0x99260d7389c05fb0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05fb7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.299817:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a41687e00/0x99260d7389c05fb0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05fb7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.299825:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789042966.299827:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789042966.299828:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789042966.299834:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789042966.299846:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7fa3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267612544:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789042966.299900:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042966.299939:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789042966.299945:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7fa3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267612416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789042966.299968:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042966.299996:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267612544 00000100:00100000:3.0:1789042966.300001:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267612544 00010000:00010000:3.0:1789042966.300022:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a58605200/0x99260d7389c05fb7 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05fb0 expref: 19 pid: 5841 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042966.300045:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267612416 00000100:00100000:3.0:1789042966.300048:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267612416 00010000:00010000:3.0:1789042966.300059:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c05fc5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05fbe expref: 20 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042966.300090:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789042966.300097:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7fa3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+20:3313:x1875947267612544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789042966.300108:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789042966.300113:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a58605200/0x99260d7389c05fb7 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05fb0 expref: 20 pid: 5841 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.300124:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a58605200/0x99260d7389c05fb7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99260d7389c05fb0 expref: 20 pid: 5841 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.300140:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789042966.300169:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7fa3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+20:3313:x1875947267612544:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042966.300176:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789042966.300190:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789042966.300196:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7fa3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267612416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789042966.300203:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789042966.300207:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c05fc5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05fbe expref: 19 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.300216:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c05fc5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99260d7389c05fbe expref: 19 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.300225:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789042966.300247:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7fa3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267612416:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042966.300266:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789042966.300304:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7fa3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267612416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789042966.300322:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7fa3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267612544:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789042966.300362:0:11668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a6fc29c00/0x99260d7389c05fa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99260d7389c05fa2 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.300373:0:11668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa06a6fc29c00/0x99260d7389c05fa9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99260d7389c05fa2 expref: 18 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042966.300382:0:11668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7fa3d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1875947267612672:0@lo:104: 00000100:00100000:3.0:1789042966.300406:0:11668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789042966.300440:0:11668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a58604200/0x99260d7389c05f9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67689e expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.300450:0:11668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa06a58604200/0x99260d7389c05f9b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67689e expref: 12 pid: 5841 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042966.300460:0:11668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7fa3fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1875947267612800:192.168.203.17@tcp:104: 00010000:00010000:3.0:1789042966.300655:0:11668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a41686600/0x99260d7389c05f94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676897 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.300664:0:11668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa06a41686600/0x99260d7389c05f94 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676897 expref: 12 pid: 5841 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042966.300672:0:11668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7fa3e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1875947267612928:192.168.203.17@tcp:104: 00000100:00100000:3.0:1789042966.300700:0:11668:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a464c7c00 going to sleep for 11 seconds 00010000:00010000:3.0:1789042966.300713:0:11668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c05fc5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99260d7389c05fbe expref: 18 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042966.300723:0:11668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a42f41180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1875947267612160:0@lo:104: 00010000:00010000:3.0:1789042966.300743:0:11668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a58605200/0x99260d7389c05fb7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99260d7389c05fb0 expref: 17 pid: 5841 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042966.300751:0:11668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7fa3e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1875947267612288:0@lo:104: 00000100:00100000:3.0:1789042966.305023:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042966.305057:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242410880 00000100:00100000:3.0:1789042966.305065:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242410880 00010000:00010000:3.0:1789042966.305101:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a58604200/0x99260d7389c05f9b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67689e expref: 13 pid: 5841 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042966.305132:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 32 00000100:00100000:3.0:1789042966.305142:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46f88450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2352:x1875947242410880:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789042966.305157:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789042966.305163:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a58604200/0x99260d7389c05f9b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67689e expref: 13 pid: 5841 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.305174:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a58604200/0x99260d7389c05f9b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67689e expref: 13 pid: 5841 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.305195:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789042966.305241:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46f88450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2352:x1875947242410880:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 100us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042966.305248:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 32 00010000:00010000:3.0:1789042966.305378:0:11668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a58604200/0x99260d7389c05f9b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67689e expref: 12 pid: 5841 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042966.305392:0:11668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7fa3fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1875947267612800:192.168.203.17@tcp:104: 00000100:00100000:1.0:1789042966.309158:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789042966.309187:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267612672 00000100:00100000:1.0:1789042966.309195:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267612672 00000100:00100000:1.0:1789042966.309262:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789042966.309273:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79efc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+3:11668:x1875947267612672:12345-0@lo:104: 00010000:00010000:1.0:1789042966.309306:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffffa06a58605c00/0x99260d7389c05fa2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05fa9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042966.309403:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789042966.309410:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79efc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+3:11668:x1875947267612672:12345-0@lo:104: Request processed in 139us (9002us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042966.309417:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1789042966.310083:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789042966.310093:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a58605c00/0x99260d7389c05fa2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c05fa9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042966.310103:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a58605c00 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:2.0:1789042966.310108:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a58605c00/0x99260d7389c05fa2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x99260d7389c05fa9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042966.310117:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a58605c00/0x99260d7389c05fa2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x99260d7389c05fa9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789042966.310124:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a58605c00/0x99260d7389c05fa2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x99260d7389c05fa9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789042966.310129:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789042966.310164:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a58605c00/0x99260d7389c05fa2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05fa9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042966.310171:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789042966.310192:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a58605c00/0x99260d7389c05fa2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05fa9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042966.310212:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a58605c00/0x99260d7389c05fa2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c05fa9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042966.310229:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789042966.310231:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789042966.310233:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789042966.310362:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a42f42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3314:1875947267613056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789042966.310411:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042966.310532:0:11668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7fa3d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1875947267612672:0@lo:104: 00000100:00100000:2.0:1789042966.310557:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267613056 00000100:00100000:2.0:1789042966.310562:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267613056 00010000:00010000:2.0:1789042966.310586:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a6fc29c00/0x99260d7389c05fa9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05fa2 expref: 17 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042966.310611:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789042966.310619:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42f40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:3314:x1875947267613056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789042966.310630:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789042966.310636:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a6fc29c00/0x99260d7389c05fa9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c05fa2 expref: 17 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042966.310647:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a6fc29c00/0x99260d7389c05fa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99260d7389c05fa2 expref: 17 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042966.310661:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a6fc29c00/0x99260d7389c05fa9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99260d7389c05fa2 expref: 17 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042966.310673:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789042966.310710:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42f40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:3314:x1875947267613056:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042966.310718:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789042966.310746:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a42f42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3314:1875947267613056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789042966.311778:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042966.313148:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242411008 00000100:00100000:3.0:1789042966.313167:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242411008 00010000:00010000:3.0:1789042966.313204:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a41686600/0x99260d7389c05f94 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676897 expref: 12 pid: 5841 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042966.313259:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 34 00000100:00100000:3.0:1789042966.313268:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+12:2352:x1875947242411008:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789042966.313280:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789042966.313285:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a41686600/0x99260d7389c05f94 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676897 expref: 12 pid: 5841 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.313296:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a41686600/0x99260d7389c05f94 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676897 expref: 12 pid: 5841 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.313315:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa06a50978800/0x99260d7389c060f9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.313323:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a50978800/0x99260d7389c060f9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.313340:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa06a50978800/0x99260d7389c060f9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.313346:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa06a50978800/0x99260d7389c060f9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.313353:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa06a50978800/0x99260d7389c060f9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.313409:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa06a50978800/0x99260d7389c060f9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.313414:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50978800 already unused, calling callback (ffffffffc1470760) 00010000:00010000:3.0:1789042966.313424:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa06a50978800/0x99260d7389c060f9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.313432:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa06a50978800/0x99260d7389c060f9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.313442:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa06a50978800/0x99260d7389c060f9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.313453:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789042966.313539:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+12:2352:x1875947242411008:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 271us (1766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042966.313546:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 34 00010000:00010000:3.0:1789042966.313600:0:11668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a41686600/0x99260d7389c05f94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676897 expref: 11 pid: 5841 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042966.313613:0:11668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7fa3e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11668:1875947267612928:192.168.203.17@tcp:104: 00010000:00010000:3.0:1789042966.313647:0:11668:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa06a50978800/0x99260d7389c060f9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.313656:0:11668:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa06a50978800/0x99260d7389c060f9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.313663:0:11668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa06a50978800/0x99260d7389c060f9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042966.313669:0:11668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a50978800/0x99260d7389c060f9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789042966.387665:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:1.0:1789042966.738832:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042966.738878:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042966.738925:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042966.739015:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242411264 00000100:00100000:2.0:1789042966.739026:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242411264 00000100:00100000:2.0:1789042966.739107:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 61 00000100:00100000:2.0:1789042966.739118:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a453a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2351:x1875947242411264:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1789042966.739190:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a453a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2351:x1875947242411264:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 74us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042966.739199:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 61 00000100:00100000:3.0:1789042966.739337:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242411136 00000100:00100000:3.0:1789042966.739349:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242411136 00000100:00100000:3.0:1789042966.739395:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242411392 00000100:00100000:3.0:1789042966.739398:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242411392 00000100:00100000:3.0:1789042966.739423:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 108 00000100:00100000:3.0:1789042966.739430:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a453a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2351:x1875947242411136:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1789042966.739467:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a453a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2351:x1875947242411136:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 37us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042966.739473:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 108 00000100:00100000:3.0:1789042966.739487:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 109 00000100:00100000:3.0:1789042966.739493:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a453a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2351:x1875947242411392:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1789042966.739547:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a453a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2351:x1875947242411392:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 53us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042966.739553:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 109 00000100:00080000:1.0:1789042966.741377:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789042966.741387:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789042966.900828:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789042967.794891:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06942106d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267613184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789042967.794964:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042967.795125:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267613184 00000100:00100000:1.0:1789042967.795133:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267613184 00000100:00100000:1.0:1789042967.795205:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789042967.795220:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42f42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267613184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789042967.795261:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789042967.795307:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42f42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267613184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042967.795314:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1789042967.795468:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789042967.795507:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06942106d80 x1875947267613184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042983 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042967.795548:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06942106d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267613184:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789042967.922736:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789042967.954378:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042967.954808:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242411520 00000100:00100000:0.0:1789042967.954820:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242411520 00000100:00100000:0.0:1789042967.954876:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 252 00000100:00100000:0.0:1789042967.954899:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46e5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+11:5595:x1875947242411520:12345-192.168.203.17@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789042967.954917:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789042967.954936:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a413a0c00/0x99260d7389c06100 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca6768eb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042967.954963:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a413a0c00/0x99260d7389c06100 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768eb expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042967.954973:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a413a0c00/0x99260d7389c06100 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768eb expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042967.954982:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a413a0c00, rc 0) 00000100:00100000:0.0:1789042967.955040:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46e5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+12:5595:x1875947242411520:12345-192.168.203.17@tcp:101:ll_cfg_requeue.0 Request processed in 142us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042967.955047:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 252 00000100:00100000:1.0:1789042967.961179:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042967.964699:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242411648 00000100:00100000:3.0:1789042967.964715:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242411648 00000100:00100000:3.0:1789042967.964790:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 253 00000100:00100000:3.0:1789042967.964801:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46e5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+12:5595:x1875947242411648:12345-192.168.203.17@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789042967.965717:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46e5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+12:5595:x1875947242411648:12345-192.168.203.17@tcp:501:ll_cfg_requeue.0 Request processed in 913us (4542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042967.965727:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 253 00000100:00100000:1.0:1789042967.968930:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042967.969005:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242411776 00000100:00100000:3.0:1789042967.969016:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242411776 00000100:00100000:3.0:1789042967.969072:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 254 00000100:00100000:3.0:1789042967.969082:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46e5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+12:5595:x1875947242411776:12345-192.168.203.17@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789042967.969327:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46e5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+12:5595:x1875947242411776:12345-192.168.203.17@tcp:503:ll_cfg_requeue.0 Request processed in 245us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042967.969335:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 254 00000100:00100000:0.0:1789042967.983510:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042967.984228:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242411904 00000100:00100000:3.0:1789042967.984253:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242411904 00000100:00100000:3.0:1789042967.984334:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 255 00000100:00100000:3.0:1789042967.984347:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46e5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+12:9953:x1875947242411904:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789042967.985493:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46e5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+12:9953:x1875947242411904:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 1138us (1988us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042967.985506:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 255 00000100:00100000:1.0:1789042967.999204:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042967.999411:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242412032 00000100:00100000:0.0:1789042967.999424:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242412032 00000100:00100000:0.0:1789042967.999500:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 256 00000100:00100000:0.0:1789042967.999543:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43887850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+12:9953:x1875947242412032:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789042968.000398:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43887850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+12:9953:x1875947242412032:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 883us (1200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042968.000409:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 256 00000100:00100000:1.0:1789042968.003237:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042968.003958:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242412160 00000100:00100000:3.0:1789042968.003972:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242412160 00000100:00100000:3.0:1789042968.004085:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 257 00000100:00100000:3.0:1789042968.004098:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43886450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+12:5595:x1875947242412160:12345-192.168.203.17@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789042968.004133:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789042968.004158:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c06107 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca6768f2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042968.004195:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c06107 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768f2 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042968.004207:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c06107 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768f2 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042968.004216:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc29e00, rc 0) 00000100:00100000:3.0:1789042968.004309:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43886450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:5595:x1875947242412160:12345-192.168.203.17@tcp:101:ll_cfg_requeue.0 Request processed in 213us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042968.004337:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 257 00000100:00100000:3.0:1789042968.007562:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042968.007663:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242412288 00000100:00100000:0.0:1789042968.007676:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242412288 00000100:00100000:0.0:1789042968.007755:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 258 00000100:00100000:0.0:1789042968.007766:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43886850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:5595:x1875947242412288:12345-192.168.203.17@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789042968.008168:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43886850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:5595:x1875947242412288:12345-192.168.203.17@tcp:501:ll_cfg_requeue.0 Request processed in 402us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042968.008178:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 258 00000100:00100000:0.0:1789042968.011864:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042968.012050:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242412416 00000100:00100000:3.0:1789042968.012064:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242412416 00000100:00100000:3.0:1789042968.012137:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 259 00000100:00100000:3.0:1789042968.012149:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43887050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:5595:x1875947242412416:12345-192.168.203.17@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789042968.012464:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43887050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:5595:x1875947242412416:12345-192.168.203.17@tcp:503:ll_cfg_requeue.0 Request processed in 316us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042968.012474:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 259 00000100:00100000:2.0:1789042968.017015:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042968.017229:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242412544 00000100:00100000:1.0:1789042968.017253:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242412544 00000100:00100000:1.0:1789042968.017344:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 260 00000100:00100000:1.0:1789042968.017356:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:9955:x1875947242412544:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789042968.017794:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:9955:x1875947242412544:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 438us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042968.017805:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 260 00000100:00100000:1.0:1789042968.023973:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042968.024252:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242412672 00000100:00100000:0.0:1789042968.024265:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242412672 00000100:00100000:0.0:1789042968.024335:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 261 00000100:00100000:0.0:1789042968.024348:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43885850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:9955:x1875947242412672:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789042968.024813:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43885850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:9955:x1875947242412672:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 361us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042968.024825:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 261 10000000:01000000:0.0:1789042968.307235:0:5844:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789042968.307256:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa06a7924a000 from 7 10000000:01000000:0.0:1789042968.307263:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789042968.307338:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a413a0a00/0x99260d7389c0610e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042968.307355:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a413a0a00/0x99260d7389c0610e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042968.307382:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a413a0a00/0x99260d7389c0610e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042968.307416:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06942106d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267613312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789042968.307511:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042968.307582:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a4733d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789042968.308391:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267613312 00000100:00100000:3.0:1789042968.308404:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267613312 00000100:00100000:3.0:1789042968.308565:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789042968.308578:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+16:5844:x1875947267613312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789042968.308598:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789042968.308620:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a6fc28e00/0x99260d7389c06115 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c0610e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042968.308654:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a6fc28e00/0x99260d7389c06115 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c0610e expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042968.308669:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a6fc28e00/0x99260d7389c06115 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c0610e expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042968.308679:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc28e00, rc 0) 00000100:00100000:3.0:1789042968.308759:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:5844:x1875947267613312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (1237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042968.308767:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789042968.310064:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06942106d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267613312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789042968.310098:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a413a0a00/0x99260d7389c0610e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06115 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042968.310111:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a413a0a00/0x99260d7389c0610e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c06115 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042968.310216:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a42f43800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267613440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789042968.310307:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042968.310350:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a48252540 going to sleep for 11 seconds 00000100:00100000:1.0:1789042968.311112:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267613440 00000100:00100000:1.0:1789042968.311123:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267613440 00000100:00100000:1.0:1789042968.311189:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789042968.311200:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43885c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:5844:x1875947267613440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789042968.311620:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43885c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:5844:x1875947267613440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 421us (1311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042968.311629:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789042968.312066:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a42f43800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267613440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789042968.312128:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a42f43800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267613568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789042968.312186:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042968.312225:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a48252540 going to sleep for 11 seconds 00000100:00100000:3.0:1789042968.312877:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267613568 00000100:00100000:3.0:1789042968.312886:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267613568 00000100:00100000:3.0:1789042968.312937:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789042968.312952:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43885050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:5844:x1875947267613568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789042968.313209:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43885050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:5844:x1875947267613568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 257us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042968.313783:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a42f43800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267613568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789042968.314133:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a42f43800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:11684:1875947267613696:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789042968.314202:0:11684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042968.314246:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a48252c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789042968.316107:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267613696 00000100:00100000:1.0:1789042968.316128:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267613696 00000100:00100000:3.0:1789042968.329807:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789042968.331413:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789042968.331449:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:11684:x1875947267613696:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789042968.333482:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:11684:x1875947267613696:12345-0@lo:502:llog_process_th.0 Request processed in 2044us (19269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042968.333498:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789042968.343420:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a42f43800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:11684:1875947267613696:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789042968.343492:0:11684:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789042968.343509:0:11684:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789042968.343537:0:11684:0:(obd_config.c:1661:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789042968.343546:0:11684:0:(obd_config.c:2102:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa06a7924a000 00000020:00000080:2.0:1789042968.343550:0:11684:0:(obd_config.c:1570:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789042968.343664:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a42f43800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:11684:1875947267613824:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789042968.343763:0:11684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042968.343818:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a48252c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789042968.343945:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267613824 00000100:00100000:1.0:1789042968.343956:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267613824 00000100:00100000:1.0:1789042968.344017:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789042968.344029:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:11684:x1875947267613824:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789042968.344329:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:11684:x1875947267613824:12345-0@lo:502:llog_process_th.0 Request processed in 302us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042968.344353:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789042968.346288:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a42f43800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:11684:1875947267613824:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789042968.346341:0:11684:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789042968.346351:0:11684:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789042968.346354:0:11684:0:(obd_config.c:1661:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789042968.346360:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789042968.347692:0:5844:0:(obd_config.c:2243:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789042968.347730:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789042968.347747:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a413a0a00/0x99260d7389c0610e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06115 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042968.347762:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a413a0a00/0x99260d7389c0610e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06115 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789042968.347777:0:5844:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789042968.347780:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa06a7924c000 from 7 10000000:01000000:1.0:1789042968.347783:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789042968.347838:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41686400/0x99260d7389c0611c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042968.347847:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a41686400/0x99260d7389c0611c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042968.347868:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a41686400/0x99260d7389c0611c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042968.347899:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a453a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267613952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789042968.347983:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042968.348038:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a48275540 going to sleep for 11 seconds 00000100:00100000:2.0:1789042968.348387:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267613952 00000100:00100000:2.0:1789042968.348415:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267613952 00000100:00100000:2.0:1789042968.348484:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789042968.348496:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:5844:x1875947267613952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789042968.348534:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789042968.348552:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a50978c00/0x99260d7389c06123 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c0611c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042968.348582:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a50978c00/0x99260d7389c06123 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c0611c expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042968.348595:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a50978c00/0x99260d7389c06123 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c0611c expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042968.348606:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50978c00, rc 0) 00000100:00100000:2.0:1789042968.348657:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:5844:x1875947267613952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042968.348664:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789042968.349411:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a453a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267613952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789042968.349437:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a41686400/0x99260d7389c0611c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06123 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042968.349447:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a41686400/0x99260d7389c0611c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c06123 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042968.354645:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a453a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267614080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789042968.354768:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042968.354824:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a48275540 going to sleep for 11 seconds 00000100:00100000:2.0:1789042968.354924:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267614080 00000100:00100000:2.0:1789042968.354934:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267614080 00000100:00100000:2.0:1789042968.355005:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789042968.355018:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:5844:x1875947267614080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789042968.355403:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:5844:x1875947267614080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 386us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042968.355414:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789042968.355924:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a453a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267614080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789042968.355982:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7fa3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267614208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789042968.356036:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042968.356070:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a55eaecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789042968.356088:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267614208 00000100:00100000:3.0:1789042968.356093:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267614208 00000100:00100000:3.0:1789042968.356125:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789042968.356132:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:5844:x1875947267614208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789042968.356324:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:5844:x1875947267614208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 190us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042968.356331:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789042968.356370:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7fa3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267614208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789042968.366715:0:11686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a453a7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:11686:1875947267614336:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789042968.366840:0:11686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042968.366911:0:11686:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a48275c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789042968.370025:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267614336 00000100:00100000:2.0:1789042968.370059:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267614336 00000100:00100000:2.0:1789042968.370147:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789042968.370160:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:11686:x1875947267614336:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789042968.370566:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:11686:x1875947267614336:12345-0@lo:502:llog_process_th.0 Request processed in 407us (3725us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042968.370576:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789042968.372023:0:11686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a453a7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:11686:1875947267614336:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789042968.372090:0:11686:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789042968.372108:0:11686:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789042968.372110:0:11686:0:(obd_config.c:1661:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789042968.372119:0:11686:0:(obd_config.c:2102:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa06a7924c000 00000020:00000080:1.0:1789042968.372122:0:11686:0:(obd_config.c:1570:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789042968.372277:0:11686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a453a7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:11686:1875947267614464:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789042968.372357:0:11686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042968.372409:0:11686:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a48275c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789042968.373669:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267614464 00000100:00100000:2.0:1789042968.373684:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267614464 00000100:00100000:2.0:1789042968.373764:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789042968.373777:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:11686:x1875947267614464:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789042968.374418:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:11686:x1875947267614464:12345-0@lo:502:llog_process_th.0 Request processed in 640us (2058us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042968.374427:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789042968.375000:0:11686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a453a7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:11686:1875947267614464:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789042968.375053:0:11686:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789042968.375065:0:11686:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789042968.375068:0:11686:0:(obd_config.c:1661:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789042968.375074:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789042968.376489:0:5844:0:(obd_config.c:2243:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789042968.376550:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789042968.376564:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41686400/0x99260d7389c0611c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06123 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042968.376578:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a41686400/0x99260d7389c0611c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06123 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789042968.376592:0:5844:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789042968.376595:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa06a52b8e800 from 7 10000000:01000000:2.0:1789042968.376599:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789042968.376647:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a50978200/0x99260d7389c0612a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042968.376656:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a50978200/0x99260d7389c0612a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042968.376667:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a50978200/0x99260d7389c0612a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042968.376721:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a42f43800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267614592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789042968.376801:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042968.376969:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267614592 00000100:00100000:0.0:1789042968.376986:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267614592 00000100:00100000:0.0:1789042968.377054:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1789042968.377065:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:5844:x1875947267614592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789042968.377079:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789042968.377095:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a413a1200/0x99260d7389c06131 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c0612a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042968.377127:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a413a1200/0x99260d7389c06131 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c0612a expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042968.377140:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a413a1200/0x99260d7389c06131 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c0612a expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042968.377149:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a413a1200, rc 0) 00000100:00100000:0.0:1789042968.377189:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:5844:x1875947267614592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042968.377196:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789042968.379466:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a482529c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789042968.380345:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a42f43800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267614592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789042968.380389:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a50978200/0x99260d7389c0612a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06131 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042968.380405:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a50978200/0x99260d7389c0612a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c06131 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042968.380958:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a42f43800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267614720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789042968.381041:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042968.381097:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a482529c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789042968.381125:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267614720 00000100:00100000:2.0:1789042968.381132:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267614720 00000100:00100000:2.0:1789042968.381194:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1789042968.381205:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:5844:x1875947267614720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789042968.381595:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:5844:x1875947267614720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 390us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042968.381605:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1789042968.381652:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a42f43800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267614720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789042968.381690:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a42f43800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267614848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789042968.381732:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042968.381748:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a482529c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789042968.381778:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267614848 00000100:00100000:2.0:1789042968.381784:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267614848 00000100:00100000:2.0:1789042968.381803:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789042968.381809:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:5844:x1875947267614848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789042968.381971:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:5844:x1875947267614848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042968.381979:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789042968.382020:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a42f43800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:5844:1875947267614848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789042968.382292:0:11687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a42f43800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:11687:1875947267614976:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789042968.382326:0:11687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042968.382344:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267614976 00000100:00100000:2.0:1789042968.382348:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267614976 00000100:00100000:2.0:1789042968.382366:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1789042968.382371:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:11687:x1875947267614976:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789042968.382500:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:11687:x1875947267614976:12345-0@lo:502:llog_process_th.0 Request processed in 128us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042968.382508:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1789042968.382565:0:11687:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a482520c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789042968.382578:0:11687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a42f43800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:11687:1875947267614976:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789042968.382601:0:11687:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789042968.382613:0:11687:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789042968.382616:0:11687:0:(obd_config.c:1661:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789042968.382623:0:11687:0:(obd_config.c:2102:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa06a52b8e800 00000020:00000080:2.0:1789042968.382625:0:11687:0:(obd_config.c:1570:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789042968.382698:0:11687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a42f43800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:11687:1875947267615104:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789042968.382731:0:11687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042968.382756:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267615104 00000100:00100000:2.0:1789042968.382760:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267615104 00000100:00100000:2.0:1789042968.382777:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789042968.382783:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:11687:x1875947267615104:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789042968.382889:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:11687:x1875947267615104:12345-0@lo:502:llog_process_th.0 Request processed in 105us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042968.382896:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789042968.382923:0:11687:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06943555300 going to sleep for 11 seconds 00000100:00100000:2.0:1789042968.382935:0:11687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a42f43800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:11687:1875947267615104:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789042968.382952:0:11687:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789042968.382956:0:11687:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789042968.382958:0:11687:0:(obd_config.c:1661:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789042968.382962:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789042968.383022:0:5844:0:(obd_config.c:2243:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789042968.383039:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789042968.383050:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a50978200/0x99260d7389c0612a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06131 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042968.383061:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a50978200/0x99260d7389c0612a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06131 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789042968.398226:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789042968.948318:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789042969.462477:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789042969.971137:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789042970.868206:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7fa3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267615488:0@lo:400:kworker.0 00000100:00100000:2.0:1789042970.868271:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7fa3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875947267615360:0@lo:400:kworker.0 00000100:00100000:1.0:1789042970.868649:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7fa3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267615232:0@lo:400:kworker.0 00000100:00100000:2.0:1789042970.870150:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042970.870228:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7fa3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267615872:0@lo:400:kworker.0 00000100:00100000:2.0:1789042970.870262:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042970.870331:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267615872 00000100:00100000:2.0:1789042970.871545:0:8215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267615872 00000100:00100000:2.0:1789042970.871636:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789042970.871808:0:8215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42f40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267615872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789042970.871888:0:8215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42f40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267615872:12345-0@lo:400:kworker.0 Request processed in 84us (1625us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042970.872245:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1789042970.872281:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789042970.872313:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1789042970.872319:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa06a7fa3f480, transno 4294967300 00000100:00100000:2.0:1789042970.872336:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7fa3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267615872:0@lo:400:kworker.0 00000100:00100000:2.0:1789042970.872870:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7fa3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267615616:0@lo:400:kworker.0 00000100:00100000:2.0:1789042970.872931:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042970.872991:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267615616 00000100:00100000:2.0:1789042970.872997:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267615616 00000100:00100000:2.0:1789042970.873035:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789042970.873041:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42f42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267615616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789042970.873080:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42f42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267615616:12345-0@lo:400:kworker.0 Request processed in 39us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042970.873087:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1789042970.873104:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789042970.873123:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7fa3e300 x1875947267615616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042970.873134:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7fa3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267615616:0@lo:400:kworker.0 00000100:00100000:2.0:1789042970.873162:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267615360 00000100:00100000:2.0:1789042970.873166:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267615360 00000100:00100000:2.0:1789042970.873196:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789042970.873202:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875947267615360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789042970.873256:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875947267615360:12345-0@lo:400:kworker.0 Request processed in 53us (3111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042970.873262:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789042970.873285:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7fa3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875947267615360:0@lo:400:kworker.0 00000100:00100000:3.0:1789042970.873729:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042970.873769:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267615488 00000100:00100000:3.0:1789042970.873773:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267615488 00000100:00100000:3.0:1789042970.873805:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789042970.873812:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7fa3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267615488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042970.873988:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7fa3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267615488:12345-0@lo:400:kworker.0 Request processed in 176us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042970.873995:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:3.0:1789042970.874016:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789042970.874053:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7fa3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267615488:0@lo:400:kworker.0 00000100:00100000:1.0:1789042970.874065:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042970.874100:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7fa3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875947267615744:0@lo:400:kworker.0 00000100:00100000:1.0:1789042970.874148:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042970.874185:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267615232 00000100:00100000:1.0:1789042970.874189:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267615232 00000100:00100000:1.0:1789042970.874217:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789042970.874242:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3312:x1875947267615232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789042970.874291:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3312:x1875947267615232:12345-0@lo:400:kworker.0 Request processed in 52us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042970.874297:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789042970.874325:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267615744 00000100:00100000:1.0:1789042970.874329:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267615744 00000100:00100000:1.0:1789042970.874363:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00080000:3.0:1789042970.874626:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789042970.874656:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a453a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875947267615744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789042970.874692:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a453a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875947267615744:12345-0@lo:400:kworker.0 Request processed in 42us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042970.874698:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789042970.874729:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7fa3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267615232:0@lo:400:kworker.0 00000100:00100000:1.0:1789042970.874740:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7fa3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875947267615744:0@lo:400:kworker.0 00010000:00010000:3.0:1789042971.002503:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789042971.379438:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789042971.381281:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06942106d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267616000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789042971.381351:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042971.381967:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267616000 00000100:00100000:0.0:1789042971.381978:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267616000 00000100:00100000:0.0:1789042971.382027:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789042971.382037:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42f43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267616000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789042971.382070:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789042971.382128:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42f43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267616000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042971.382135:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789042971.382684:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06942106d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267616000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789042971.855981:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042971.856024:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042971.856055:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042971.856101:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042971.856397:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242412800 00000100:00100000:1.0:1789042971.856408:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242412800 00000100:00100000:1.0:1789042971.856472:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 278 00000100:00100000:1.0:1789042971.856482:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2352:x1875947242412800:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1789042971.856830:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2352:x1875947242412800:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 105us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042971.856838:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 278 00000100:00100000:2.0:1789042971.857573:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242413056 00000100:00100000:2.0:1789042971.857582:0:8215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242413056 00000100:00100000:2.0:1789042971.857657:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 64 00000100:00100000:2.0:1789042971.857666:0:8215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942106d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2352:x1875947242413056:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1789042971.857728:0:8215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942106d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2352:x1875947242413056:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 62us (1702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042971.857734:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 64 00000100:00080000:0.0:1789042971.857936:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789042971.858281:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242412928 00000100:00100000:3.0:1789042971.858288:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242412928 00000100:00100000:3.0:1789042971.858385:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242413184 00000100:00100000:3.0:1789042971.858389:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242413184 00000100:00100000:3.0:1789042971.858423:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 113 00000100:00100000:3.0:1789042971.858431:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2352:x1875947242412928:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1789042971.858728:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 114 00000100:00100000:1.0:1789042971.858756:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2352:x1875947242413184:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1789042971.858799:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2352:x1875947242413184:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 49us (2697us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042971.858806:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 114 00000100:00080000:0.0:1789042971.858938:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789042971.859362:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2352:x1875947242412928:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 929us (3302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042971.859370:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 113 00010000:00010000:2.0:1789042972.018694:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789042972.918899:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789042972.920054:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267616128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789042972.921001:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042972.922781:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267616128 00000100:00100000:0.0:1789042972.922794:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267616128 00000100:00080000:3.0:1789042972.922958:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789042972.923314:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789042972.923326:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7fa3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267616128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789042972.923410:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789042972.923658:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7fa3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267616128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 334us (2726us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042972.923666:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1789042972.923991:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a767d8a80 x1875947267616128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042988 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042972.924012:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267616128:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789042973.044255:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789042974.067536:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789042975.090899:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789042975.986828:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a453a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267616640:0@lo:400:kworker.0 00000100:00100000:1.0:1789042975.986895:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042975.986954:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789042975.986960:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a453a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875947267616512:0@lo:400:kworker.0 00000100:00100000:1.0:1789042975.986985:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042975.987027:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267616640 00000100:00100000:1.0:1789042975.987035:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267616640 00000100:00100000:1.0:1789042975.987085:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789042975.987100:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a453a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267616640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789042975.987146:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a453a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267616640:12345-0@lo:400:kworker.0 Request processed in 53us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042975.987153:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789042975.987173:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267616512 00000100:00100000:1.0:1789042975.987177:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267616512 00000100:00100000:1.0:1789042975.987211:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789042975.987218:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a453a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875947267616512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789042975.987247:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a453a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875947267616512:12345-0@lo:400:kworker.0 Request processed in 30us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042975.987253:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789042975.987288:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a453a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875947267616512:0@lo:400:kworker.0 00010000:00080000:1.0:1789042975.987301:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a453a6680 x1875947267616640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789042975.987324:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a453a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267616640:0@lo:400:kworker.0 00000100:00100000:3.0:1789042975.987409:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a453a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875947267616384:0@lo:400:kworker.0 00000100:00100000:3.0:1789042975.987443:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042975.987472:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a453a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267616896:0@lo:400:kworker.0 00000100:00100000:3.0:1789042975.987492:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042975.987511:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789042975.987538:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a453a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267616256:0@lo:400:kworker.0 00000100:00100000:3.0:1789042975.987565:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042975.987588:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a453a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875947267616768:0@lo:400:kworker.0 00000100:00100000:3.0:1789042975.987609:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042975.987633:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267616896 00000100:00100000:3.0:1789042975.987636:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267616896 00000100:00100000:3.0:1789042975.987664:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789042975.987670:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7fa3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267616896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042975.987704:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7fa3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267616896:12345-0@lo:400:kworker.0 Request processed in 34us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042975.987710:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789042975.987730:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267616256 00000100:00100000:3.0:1789042975.987733:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267616256 00000100:00100000:3.0:1789042975.987756:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1789042975.987762:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267616256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042975.987789:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267616256:12345-0@lo:400:kworker.0 Request processed in 27us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042975.987795:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1789042975.987819:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267616384 00000100:00100000:3.0:1789042975.987822:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267616384 00000100:00100000:3.0:1789042975.987842:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267616768 00000100:00100000:3.0:1789042975.987844:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267616768 00000100:00100000:3.0:1789042975.987861:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789042975.987874:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7fa3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875947267616384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042975.987903:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7fa3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875947267616384:12345-0@lo:400:kworker.0 Request processed in 30us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042975.987909:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789042975.987920:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789042975.987926:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7fa3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875947267616768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042975.987950:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7fa3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875947267616768:12345-0@lo:400:kworker.0 Request processed in 25us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042975.987956:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:3.0:1789042975.987977:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789042975.987981:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789042975.987983:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789042975.987998:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a453a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267616256:0@lo:400:kworker.0 00000100:00100000:3.0:1789042975.988008:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a453a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875947267616768:0@lo:400:kworker.0 00000100:00100000:3.0:1789042975.988016:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a453a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875947267616384:0@lo:400:kworker.0 00000100:00100000:3.0:1789042975.988025:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a453a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267616896:0@lo:400:kworker.0 00010000:00010000:3.0:1789042976.114812:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789042976.498955:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789042976.498982:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267617024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789042976.499047:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042976.499120:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267617024 00000100:00100000:1.0:1789042976.499127:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267617024 00000100:00100000:1.0:1789042976.499190:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789042976.499199:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a453a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267617024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789042976.499229:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789042976.499277:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a453a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267617024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042976.499284:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789042976.499314:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267617024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789042976.976684:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042976.976734:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042976.976761:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042976.976849:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042976.976882:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242413312 00000100:00100000:2.0:1789042976.976892:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242413312 00000100:00100000:2.0:1789042976.976941:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 280 00000100:00100000:2.0:1789042976.976951:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2352:x1875947242413312:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1789042976.977028:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2352:x1875947242413312:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 78us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042976.977036:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 280 00000100:00100000:2.0:1789042976.977131:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242413568 00000100:00100000:2.0:1789042976.977135:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242413568 00000100:00100000:2.0:1789042976.977171:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 67 00000100:00100000:2.0:1789042976.978296:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42f41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2352:x1875947242413568:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1789042976.978343:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42f41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2352:x1875947242413568:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 55us (1608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042976.978349:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 67 00000100:00100000:1.0:1789042976.978689:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242413440 00000100:00100000:1.0:1789042976.978696:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242413440 00000100:00100000:1.0:1789042976.978730:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242413696 00000100:00100000:1.0:1789042976.978733:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242413696 00000100:00100000:1.0:1789042976.978756:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 118 00000100:00100000:1.0:1789042976.978762:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2351:x1875947242413440:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1789042976.978796:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2351:x1875947242413440:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 34us (2034us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042976.978802:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 118 00000100:00100000:1.0:1789042976.978815:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 119 00000100:00100000:1.0:1789042976.978822:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2351:x1875947242413696:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1789042976.978845:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2351:x1875947242413696:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 24us (1997us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042976.978861:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 119 00000100:00080000:2.0:1789042976.978948:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789042976.978952:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789042977.138654:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789042978.037044:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789042978.037068:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267617152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789042978.037136:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042978.037784:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267617152 00000100:00100000:0.0:1789042978.037794:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267617152 00000100:00100000:0.0:1789042978.037872:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789042978.037883:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7fa3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267617152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789042978.037918:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789042978.037971:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7fa3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267617152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042978.037977:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1789042978.038198:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789042978.038235:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a767da680 x1875947267617152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042994 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042978.038254:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267617152:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789042978.162754:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789042979.187305:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789042979.699242:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789042980.210892:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789042981.107055:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a79c79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267617280:0@lo:400:kworker.0 00000100:00100000:1.0:1789042981.107132:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042981.107245:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267617280 00000100:00100000:3.0:1789042981.107267:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267617280 00000100:00100000:3.0:1789042981.107322:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1789042981.107332:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a45210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3312:x1875947267617280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789042981.107837:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a79c7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875947267617408:0@lo:400:kworker.0 00000100:00100000:0.0:1789042981.107905:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042981.107954:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267617408 00000100:00100000:0.0:1789042981.107961:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267617408 00000100:00100000:0.0:1789042981.108000:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789042981.108008:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875947267617408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789042981.108055:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875947267617408:12345-0@lo:400:kworker.0 Request processed in 47us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042981.108077:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789042981.108121:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a79c7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875947267617408:0@lo:400:kworker.0 00000100:00100000:3.0:1789042981.108506:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a45210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3312:x1875947267617280:12345-0@lo:400:kworker.0 Request processed in 1172us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042981.108527:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1789042981.108647:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a79c79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267617280:0@lo:400:kworker.0 00000100:00100000:1.0:1789042981.109036:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a79c78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267617536:0@lo:400:kworker.0 00000100:00100000:1.0:1789042981.109082:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042981.109171:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789042981.109179:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a79c7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267617664:0@lo:400:kworker.0 00000100:00100000:1.0:1789042981.109206:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042981.109256:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267617536 00000100:00100000:1.0:1789042981.109263:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267617536 00000100:00100000:1.0:1789042981.109317:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789042981.109333:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a453a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267617536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042981.109336:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267617664 00000100:00100000:3.0:1789042981.109346:0:8215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267617664 00000100:00100000:1.0:1789042981.109388:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a453a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267617536:12345-0@lo:400:kworker.0 Request processed in 59us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042981.109396:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:1.0:1789042981.109426:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789042981.109430:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789042981.109449:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a79c78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267617536:0@lo:400:kworker.0 00000100:00100000:1.0:1789042981.109668:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a79c79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875947267617792:0@lo:400:kworker.0 00000100:00100000:1.0:1789042981.109694:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042981.109757:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789042981.109764:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a79c79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267617920:0@lo:400:kworker.0 00000100:00100000:1.0:1789042981.109805:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042981.109908:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267617792 00000100:00100000:1.0:1789042981.109914:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267617792 00000100:00100000:3.0:1789042981.109924:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267617920 00000100:00100000:3.0:1789042981.109932:0:8215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267617920 00000100:00100000:1.0:1789042981.109964:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789042981.109976:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789042981.109981:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a453a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875947267617792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042981.109993:0:8215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a453a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267617664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042981.110085:0:8215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a453a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267617664:12345-0@lo:400:kworker.0 Request processed in 95us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042981.110092:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789042981.110102:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789042981.110111:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a453a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267617920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789042981.110196:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a453a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875947267617792:12345-0@lo:400:kworker.0 Request processed in 217us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042981.110205:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:1.0:1789042981.110245:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789042981.110733:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a79c7a680 x1875947267617664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789042997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789042981.110752:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a79c7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267617664:0@lo:400:kworker.0 00000100:00080000:1.0:1789042981.112768:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789042981.113016:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a453a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267617920:12345-0@lo:400:kworker.0 Request processed in 2907us (3204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042981.113029:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a79c79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267617920:0@lo:400:kworker.0 00000100:00100000:2.0:1789042981.113033:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789042981.113069:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a79c79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875947267617792:0@lo:400:kworker.0 00010000:00010000:2.0:1789042981.234705:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789042981.620323:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a79c7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267618048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789042981.620401:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042981.627373:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267618048 00000100:00100000:2.0:1789042981.627389:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267618048 00000100:00100000:2.0:1789042981.627466:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789042981.627477:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267618048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789042981.627546:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789042981.627631:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267618048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (7220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042981.627654:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789042981.627985:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a79c7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267618048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789042982.099509:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042982.099589:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042982.099606:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242413824 00000100:00100000:1.0:1789042982.099616:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242413824 00000100:00100000:1.0:1789042982.099727:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 282 00000100:00100000:1.0:1789042982.099739:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2349:x1875947242413824:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1789042982.099745:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242413952 00000100:00100000:3.0:1789042982.099749:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242413952 00000100:00100000:3.0:1789042982.099795:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 123 00000100:00100000:3.0:1789042982.099803:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79c78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2349:x1875947242413952:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1789042982.099804:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2349:x1875947242413824:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 68us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042982.099811:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 282 00000100:00100000:3.0:1789042982.099833:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79c78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2349:x1875947242413952:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 31us (244us total) trans 0 rc 0/0 00000100:00080000:2.0:1789042982.099866:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789042982.099925:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 123 00000100:00100000:1.0:1789042982.116231:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042982.116285:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042982.116446:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242414208 00000100:00100000:0.0:1789042982.116455:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242414208 00000100:00080000:2.0:1789042982.116541:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789042982.116548:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 124 00000100:00100000:0.0:1789042982.116559:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a453a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2349:x1875947242414208:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1789042982.116635:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a453a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2349:x1875947242414208:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 78us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042982.116642:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 124 00000100:00100000:3.0:1789042982.116654:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242414080 00000100:00100000:3.0:1789042982.116805:0:8215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242414080 00000100:00100000:3.0:1789042982.116855:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 19 00000100:00100000:3.0:1789042982.116863:0:8215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a453a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2348:x1875947242414080:12345-192.168.203.17@tcp:9:kworker.0 00000020:00000080:3.0:1789042982.116882:0:8215:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x99260d7389c0606d 00000100:00080000:3.0:1789042982.116891:0:8215:0:(import.c:65:import_set_state_nolock()) ffffa06942b65800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789042982.116935:0:8215:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:2.0:1789042982.117014:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789042982.117266:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789042982.117635:0:8215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a453a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+2:2348:x1875947242414080:12345-192.168.203.17@tcp:9:kworker.0 Request processed in 771us (1411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042982.117644:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 19 00010000:00010000:3.0:1789042982.263541:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789042983.154999:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267618176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789042983.155097:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042983.155280:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267618176 00000100:00100000:2.0:1789042983.155291:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267618176 00000100:00100000:2.0:1789042983.155374:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789042983.155385:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a453a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267618176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789042983.155438:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789042983.155544:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789042983.159282:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a767da680 x1875947267618176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789042999 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789042983.159319:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267618176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789042983.159336:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a453a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267618176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3883us (4170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042983.159353:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00010000:2.0:1789042983.286918:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789042984.306721:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789042985.339277:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789042986.226877:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7fa3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267618560:0@lo:400:kworker.0 00000100:00100000:3.0:1789042986.226956:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042986.227025:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789042986.227031:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7fa3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267618688:0@lo:400:kworker.0 00000100:00100000:3.0:1789042986.227068:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042986.227423:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7fa3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267618304:0@lo:400:kworker.0 00000100:00100000:2.0:1789042986.227427:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7fa3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875947267618432:0@lo:400:kworker.0 00000100:00100000:0.0:1789042986.227579:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267618688 00000100:00100000:0.0:1789042986.227587:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267618688 00000100:00100000:0.0:1789042986.227639:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789042986.227647:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f85e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267618688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042986.228146:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267618560 00000100:00100000:3.0:1789042986.228153:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267618560 00000100:00100000:3.0:1789042986.228183:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789042986.228190:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7fa3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267618560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789042986.235809:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042986.235867:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7fa3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267618944:0@lo:400:kworker.0 00000100:00100000:2.0:1789042986.235910:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042986.235933:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042986.235983:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7fa3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875947267618816:0@lo:400:kworker.0 00000100:00100000:1.0:1789042986.236021:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042986.236078:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267618304 00000100:00100000:1.0:1789042986.236086:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267618304 00000100:00100000:1.0:1789042986.236149:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1789042986.236161:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3312:x1875947267618304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789042986.236162:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267618944 00000100:00100000:2.0:1789042986.236169:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267618944 00000100:00100000:2.0:1789042986.236209:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789042986.236222:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3312:x1875947267618304:12345-0@lo:400:kworker.0 Request processed in 63us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042986.236223:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79c78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267618944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789042986.236238:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1789042986.236275:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79c78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267618944:12345-0@lo:400:kworker.0 Request processed in 56us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042986.236284:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789042986.236294:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267618432 00000100:00100000:1.0:1789042986.236299:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267618432 00000100:00100000:1.0:1789042986.236322:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267618816 00000100:00100000:2.0:1789042986.236330:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789042986.236336:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267618816 00000100:00100000:2.0:1789042986.236343:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79c7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875947267618432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789042986.236368:0:5845:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1789042986.236377:0:5845:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1789042986.236386:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79c7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875947267618432:12345-0@lo:400:kworker.0 Request processed in 45us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042986.236394:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789042986.236408:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789042986.236414:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a453a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875947267618816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789042986.236446:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a453a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875947267618816:12345-0@lo:400:kworker.0 Request processed in 33us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042986.236453:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789042986.236487:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7fa3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267618304:0@lo:400:kworker.0 00000100:00100000:2.0:1789042986.236495:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7fa3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875947267618432:0@lo:400:kworker.0 00000100:00100000:1.0:1789042986.236506:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7fa3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875947267618816:0@lo:400:kworker.0 00000100:00100000:2.0:1789042986.236535:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7fa3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267618944:0@lo:400:kworker.0 00010000:00080000:2.0:1789042986.236607:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7fa3f480 x1875947267618688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789043002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042986.236620:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7fa3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267618688:0@lo:400:kworker.0 00000100:00080000:2.0:1789042986.236650:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789042986.236654:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789042986.236656:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789042986.239483:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f85e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267618688:12345-0@lo:400:kworker.0 Request processed in 8398us (8975us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042986.239501:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789042986.239759:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7fa3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267618560:12345-0@lo:400:kworker.0 Request processed in 11567us (12811us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042986.239768:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789042986.240103:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7fa3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267618560:0@lo:400:kworker.0 00010000:00010000:2.0:1789042986.354944:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789042986.742276:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a79c7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267619072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789042986.742336:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042986.742403:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267619072 00000100:00100000:2.0:1789042986.742410:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267619072 00000100:00100000:2.0:1789042986.742446:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789042986.742453:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79c7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267619072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789042986.742505:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789042986.742571:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79c7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267619072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042986.742587:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789042986.742639:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a79c7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267619072:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1789042986.836133:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3fb32839-ebfd-4c0f-90e4-f036c86704df 00000020:00000080:2.0:1789042986.836144:0:7647:0:(genops.c:893:class_export_put()) final put ffffa06942b66800/3fb32839-ebfd-4c0f-90e4-f036c86704df 00000020:00000080:2.0:1789042986.836171:0:470:0:(genops.c:852:class_export_destroy()) destroying export ffffa06942b66800/3fb32839-ebfd-4c0f-90e4-f036c86704df for lustre-OST0001 00000020:00000080:2.0:1789042986.836218:0:470:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffffa06942b65800 for lustre-OST0001 00000100:00100000:1.0:1789042987.222267:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042987.222316:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042987.222357:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042987.222447:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242414592 00000100:00100000:2.0:1789042987.222458:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242414592 00000100:00080000:1.0:1789042987.222698:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789042987.222767:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242414464 00000100:00100000:2.0:1789042987.222772:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242414464 00000100:00100000:2.0:1789042987.222802:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 128 00000100:00100000:2.0:1789042987.222811:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a453a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2352:x1875947242414592:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1789042987.222885:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a453a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2352:x1875947242414592:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 75us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042987.222893:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 128 00000100:00100000:2.0:1789042987.222909:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 129 00000100:00100000:2.0:1789042987.222987:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a453a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2352:x1875947242414464:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1789042987.223015:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a453a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2352:x1875947242414464:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 32us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042987.223022:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 129 00000100:00080000:2.0:1789042987.223362:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789042987.223492:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242414336 00000100:00100000:3.0:1789042987.223497:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242414336 00000100:00100000:3.0:1789042987.223561:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 284 00000100:00100000:3.0:1789042987.223569:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2352:x1875947242414336:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1789042987.223712:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2352:x1875947242414336:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 142us (1454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042987.223719:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 284 00010000:00010000:1.0:1789042987.378768:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789042988.280589:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789042988.280626:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a79c7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267619200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789042988.280691:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042988.280748:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267619200 00000100:00100000:2.0:1789042988.280755:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267619200 00000100:00100000:2.0:1789042988.280805:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789042988.280815:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79c78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267619200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789042988.280850:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789042988.280893:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79c78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267619200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042988.280900:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1789042988.280924:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789042988.280953:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a79c7a300 x1875947267619200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789043004 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042988.280970:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a79c7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267619200:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789042988.403752:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789042989.426897:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789042989.942540:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789042990.452149:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789042990.774905:0:11852:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 08:23:09 (1789042989) 00000100:00100000:0.0:1789042991.347837:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a453a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267619328:0@lo:400:kworker.0 00000100:00100000:1.0:1789042991.347864:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7fa3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875947267619456:0@lo:400:kworker.0 00000100:00100000:3.0:1789042991.348232:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7fa3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267619712:0@lo:400:kworker.0 00000100:00100000:2.0:1789042991.348313:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7fa3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267619584:0@lo:400:kworker.0 00000100:00100000:0.0:1789042991.350281:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042991.350332:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7fa3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875947267619840:0@lo:400:kworker.0 00000100:00100000:0.0:1789042991.350404:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042991.350442:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267619328 00000100:00100000:0.0:1789042991.350449:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267619328 00000100:00100000:0.0:1789042991.350762:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1789042991.350772:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3312:x1875947267619328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789042991.350820:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3312:x1875947267619328:12345-0@lo:400:kworker.0 Request processed in 49us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042991.350827:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1789042991.350938:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a453a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267619328:0@lo:400:kworker.0 00000100:00100000:0.0:1789042991.350975:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267619840 00000100:00100000:0.0:1789042991.350979:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267619840 00000100:00100000:0.0:1789042991.351136:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789042991.351144:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875947267619840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789042991.351233:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875947267619840:12345-0@lo:400:kworker.0 Request processed in 90us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042991.351240:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:0.0:1789042991.351261:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789042991.351281:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7fa3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875947267619840:0@lo:400:kworker.0 00000100:00100000:1.0:1789042991.351762:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042991.351796:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7fa3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267619968:0@lo:400:kworker.0 00000100:00100000:1.0:1789042991.351824:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042991.351855:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267619968 00000100:00100000:1.0:1789042991.351859:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267619968 00000100:00100000:1.0:1789042991.351892:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789042991.351904:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7fa3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267619968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789042991.351941:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7fa3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267619968:12345-0@lo:400:kworker.0 Request processed in 42us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042991.351950:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1789042991.351964:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789042991.351983:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7fa3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267619968:0@lo:400:kworker.0 00000100:00100000:0.0:1789042991.352648:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267619456 00000100:00100000:0.0:1789042991.352653:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267619456 00000100:00100000:0.0:1789042991.352688:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789042991.352694:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7fa3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875947267619456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789042991.352733:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7fa3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875947267619456:12345-0@lo:400:kworker.0 Request processed in 40us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042991.352759:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789042991.355019:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042991.355446:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7fa3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875947267619456:0@lo:400:kworker.0 00000100:00100000:2.0:1789042991.358698:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789042991.358915:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267619584 00000100:00100000:1.0:1789042991.358924:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267619584 00000100:00100000:1.0:1789042991.358991:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789042991.359008:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79c7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267619584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789042991.359061:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79c7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267619584:12345-0@lo:400:kworker.0 Request processed in 63us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042991.359068:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789042991.359117:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7fa3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267619584:0@lo:400:kworker.0 00000100:00080000:2.0:1789042991.361434:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789042991.362757:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267619712 00000100:00100000:0.0:1789042991.362769:0:8215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267619712 00000100:00100000:0.0:1789042991.362834:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789042991.362908:0:8215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a026d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267619712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789042991.363056:0:8215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a026d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267619712:12345-0@lo:400:kworker.0 Request processed in 214us (8040us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042991.363063:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1789042991.363152:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789042991.370711:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7fa3c700 x1875947267619712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789043007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789042991.370730:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7fa3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267619712:0@lo:400:kworker.0 00010000:00010000:3.0:1789042991.474853:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789042991.859280:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267620096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789042991.859360:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042991.859576:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267620096 00000100:00100000:3.0:1789042991.859585:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267620096 00000100:00100000:3.0:1789042991.859639:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789042991.859646:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7fa3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267620096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789042991.859676:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789042991.867463:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7fa3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267620096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7807us (8093us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042991.867477:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789042991.871195:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267620096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789042992.337890:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042992.337944:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042992.337999:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042992.338029:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242414720 00000100:00100000:3.0:1789042992.338040:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242414720 00000100:00100000:3.0:1789042992.338104:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 286 00000100:00100000:3.0:1789042992.338115:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2349:x1875947242414720:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1789042992.338148:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242414848 00000100:00100000:2.0:1789042992.338154:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242414848 00000100:00100000:3.0:1789042992.338202:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2349:x1875947242414720:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 88us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042992.338206:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242414976 00000100:00100000:2.0:1789042992.338211:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242414976 00000100:00100000:3.0:1789042992.338212:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 286 00000100:00100000:2.0:1789042992.338236:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 133 00000100:00100000:2.0:1789042992.338246:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7fa3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2349:x1875947242414848:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1789042992.338294:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7fa3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2349:x1875947242414848:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 50us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042992.338301:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 133 00000100:00100000:2.0:1789042992.338319:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 134 00000100:00100000:2.0:1789042992.338326:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7fa3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2349:x1875947242414976:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1789042992.338358:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7fa3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2349:x1875947242414976:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 32us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042992.338365:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 134 00000100:00080000:1.0:1789042992.339624:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789042992.498904:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789042992.749358:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042992.749508:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242415104 00000100:00100000:0.0:1789042992.749725:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242415104 00000100:00100000:0.0:1789042992.749815:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 32 00000100:00100000:0.0:1789042992.749828:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7fa3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:10226:x1875947242415104:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789042992.749858:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789042992.750093:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0200/0x99260d7389c06138 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca6768f9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042992.750193:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c0613f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042992.750208:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c0613f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042992.750223:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c0613f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789042992.750260:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789042992.750265:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789042992.750317:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c0613f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042992.750362:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0200/0x99260d7389c06138 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768f9 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042992.750383:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c0613f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768f9 expref: 6 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042992.750392:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a55221200) 00010000:00010000:0.0:1789042992.750395:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789042992.750399:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a413a0800, rc 0) 00000100:00100000:0.0:1789042992.750494:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7fa3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:10226:x1875947242415104:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 668us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042992.750503:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 32 00000100:00100000:3.0:1789042992.767695:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042992.767809:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242415232 00000100:00100000:0.0:1789042992.767821:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242415232 00000100:00100000:0.0:1789042992.767884:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 33 00000100:00100000:0.0:1789042992.767895:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:10227:x1875947242415232:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789042992.767916:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789042992.767939:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0200/0x99260d7389c06146 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676900 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042992.768007:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c0614d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042992.768023:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c0614d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042992.768036:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c0614d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042992.768079:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06154 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042992.768088:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06154 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042992.768095:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06154 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042992.768497:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40030400/0x99260d7389c0615b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042992.768507:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40030400/0x99260d7389c0615b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042992.768653:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40030400/0x99260d7389c0615b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789042992.768684:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789042992.768688:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789042992.768706:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40030400/0x99260d7389c0615b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042992.768717:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c0614d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042992.768723:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c0614d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042992.768730:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c0614d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042992.768746:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a413a0600 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789042992.768750:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c0614d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042992.768758:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c0614d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042992.768769:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a55221200) 00010000:00010000:0.0:1789042992.768773:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789042992.768777:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c0614d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042992.768784:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c0614d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042992.768795:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06154 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042992.768800:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06154 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042992.768806:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06154 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042992.768811:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a413a0e00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789042992.768813:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06154 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042992.768819:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06154 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042992.768835:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffffa06a55221e00) 00010000:00010000:0.0:1789042992.768837:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789042992.768840:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06154 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042992.768846:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06154 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042992.768878:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0200/0x99260d7389c06146 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676900 expref: 8 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042992.768890:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40030400/0x99260d7389c0615b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676900 expref: 7 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042992.768896:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa06a55221400) 00010000:00010000:0.0:1789042992.768898:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789042992.768900:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a40030400, rc 0) 00000100:00100000:0.0:1789042992.769008:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:10227:x1875947242415232:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 1115us (1324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042992.769016:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 33 00000100:00100000:3.0:1789042992.781884:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042992.783410:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242415488 00000100:00100000:1.0:1789042992.783422:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242415488 00000100:00100000:1.0:1789042992.783700:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 34 00000100:00100000:1.0:1789042992.783713:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:10227:x1875947242415488:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789042992.783734:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789042992.783754:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06162 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676907 expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042992.783833:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06169 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042992.783849:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06169 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042992.783860:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06169 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042992.783914:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06170 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042992.783923:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06170 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042992.783931:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06170 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042992.784830:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687c00/0x99260d7389c06177 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042992.784844:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687c00/0x99260d7389c06177 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042992.784851:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687c00/0x99260d7389c06177 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789042992.784862:0:11703:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1789042992.785020:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06169 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042992.785028:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06169 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042992.785034:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06169 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042992.785041:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686600 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789042992.785045:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06169 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042992.785052:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06169 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042992.785063:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa06a55221400) 00010000:00010000:1.0:1789042992.785074:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789042992.785079:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06169 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042992.785097:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06169 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042992.785110:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06170 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042992.785115:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06170 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042992.785120:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06170 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042992.785180:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687e00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789042992.785184:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06170 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042992.785190:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06170 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042992.785199:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffffa06a44e19200) 00010000:00010000:1.0:1789042992.785201:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789042992.785204:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06170 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042992.785210:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06170 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042992.785996:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06162 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676907 expref: 10 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042992.786024:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687c00/0x99260d7389c06177 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676907 expref: 9 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042992.786032:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa06a44e19600) 00010000:00010000:1.0:1789042992.786034:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789042992.786036:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41687c00, rc 0) 00000100:00100000:1.0:1789042992.786729:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+9:10227:x1875947242415488:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 3017us (4851us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789042992.786738:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 34 00000100:00100000:1.0:1789042992.801912:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042992.803857:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242415616 00000100:00100000:2.0:1789042992.803871:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242415616 00000100:00100000:2.0:1789042992.803946:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 35 00000100:00100000:2.0:1789042992.803957:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5289ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+9:10227:x1875947242415616:12345-192.168.203.17@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789042992.804085:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5289ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+9:10227:x1875947242415616:12345-192.168.203.17@tcp:59:lhsmtool_posix.0 Request processed in 129us (2185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042992.804094:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 35 00000040:00080000:3.0:1789042993.012206:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789042993.396595:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267620224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789042993.396690:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042993.397291:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267620224 00000100:00100000:2.0:1789042993.397300:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267620224 00000100:00100000:2.0:1789042993.399417:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789042993.399432:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79c79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267620224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789042993.399728:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789042993.400119:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79c79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267620224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 689us (3426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042993.400138:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1789042993.400172:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789042993.400209:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a767da680 x1875947267620224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789043009 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789042993.400228:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267620224:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789042993.524241:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789042994.547680:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789042995.142139:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042995.142507:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242415744 00000100:00100000:1.0:1789042995.142535:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242415744 00000100:00100000:1.0:1789042995.142604:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 36 00000100:00100000:1.0:1789042995.142615:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79c79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+9:10269:x1875947242415744:12345-192.168.203.17@tcp:101:lfs.0 00000100:00080000:2.0:1789042995.142625:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789042995.142637:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789042995.143934:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06185 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca67690e expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.144015:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c0618c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.144030:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c0618c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.144044:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c0618c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.144089:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687600/0x99260d7389c06193 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.144098:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687600/0x99260d7389c06193 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.144105:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687600/0x99260d7389c06193 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.144285:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c0618c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.144294:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c0618c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.144302:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c0618c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.144308:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686600 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789042995.144312:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c0618c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.144320:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c0618c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.144331:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a55221200) 00010000:00010000:1.0:1789042995.144334:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789042995.144339:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c0618c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.144346:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c0618c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.144363:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687600/0x99260d7389c06193 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.144369:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687600/0x99260d7389c06193 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.144374:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687600/0x99260d7389c06193 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.144379:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687600 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789042995.144381:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687600/0x99260d7389c06193 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.144387:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687600/0x99260d7389c06193 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.144394:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffffa06a44e19000) 00010000:00010000:1.0:1789042995.144396:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789042995.144399:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687600/0x99260d7389c06193 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.144405:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687600/0x99260d7389c06193 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.144444:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06185 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67690e expref: 10 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.144454:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a55221200) 00010000:00010000:1.0:1789042995.144456:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789042995.144465:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06185 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67690e expref: 10 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.144474:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41687e00, rc 0) 00000100:00100000:1.0:1789042995.144565:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79c79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+9:10269:x1875947242415744:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 1951us (2434us total) trans 0 rc 301/301 00000100:00100000:1.0:1789042995.144574:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 36 00000100:00100000:3.0:1789042995.168685:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042995.171674:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242416000 00000100:00100000:2.0:1789042995.171690:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242416000 00000100:00100000:2.0:1789042995.171763:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 37 00000100:00100000:2.0:1789042995.171772:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+9:10269:x1875947242416000:12345-192.168.203.17@tcp:36:lfs.0 00010000:00010000:2.0:1789042995.171829:0:11703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789042995.171858:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c0613f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768f9 expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.171877:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a55221200) 00010000:00010000:2.0:1789042995.171887:0:11703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789042995.172110:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c0619a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.172124:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c0619a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.172135:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c0619a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.172148:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c061a1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.172168:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c061a1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.172175:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c061a1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789042995.173064:0:11703:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789042995.173076:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c0619a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.173084:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c0619a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.173090:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c0619a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.173096:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789042995.173100:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c0619a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.173108:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c0619a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.173120:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a457d3200) 00010000:00010000:2.0:1789042995.173123:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789042995.173127:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c0619a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.173132:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c0619a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789042995.173161:0:11703:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e0428c25 reply state 00000000a29bb981 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c061a1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042995.173170:0:11703:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789042995.173284:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+10:10269:x1875947242416000:12345-192.168.203.17@tcp:36:lfs.0 Request processed in 1511us (4606us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789042995.173292:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 37 00010000:00010000:3.0:1789042995.184847:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c061a1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042995.184869:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c061a1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042995.184877:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c061a1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042995.184883:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50978a00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789042995.184887:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c061a1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042995.184895:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c061a1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042995.184912:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffffa06a457d3c00) 00010000:00010000:3.0:1789042995.184915:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789042995.184920:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c061a1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042995.184937:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c061a1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042995.293553:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042995.293750:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242416128 00000100:00100000:1.0:1789042995.293766:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242416128 00000100:00100000:1.0:1789042995.293821:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 38 00000100:00100000:1.0:1789042995.293832:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+9:10277:x1875947242416128:12345-192.168.203.17@tcp:101:lctl.0 00010000:00010000:1.0:1789042995.293943:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789042995.293966:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c061a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676915 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.294031:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687600/0x99260d7389c061af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.294046:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687600/0x99260d7389c061af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.294070:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687600/0x99260d7389c061af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789042995.294105:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789042995.294109:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789042995.294145:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687600/0x99260d7389c061af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.294168:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c061a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676915 expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.294200:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687600/0x99260d7389c061af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676915 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.294208:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a44e19000) 00010000:00010000:1.0:1789042995.294211:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789042995.294215:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41687600, rc 0) 00000100:00100000:1.0:1789042995.296310:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+10:10277:x1875947242416128:12345-192.168.203.17@tcp:101:lctl.0 Request processed in 2468us (2755us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042995.296323:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 38 00000100:00100000:2.0:1789042995.406481:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042995.407567:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242416256 00000100:00100000:1.0:1789042995.407579:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242416256 00000100:00100000:1.0:1789042995.407645:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 39 00000100:00100000:1.0:1789042995.407656:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79c78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+10:10283:x1875947242416256:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:1.0:1789042995.407676:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789042995.407696:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c061b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca67691c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.407761:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c061bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.407774:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c061bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.407786:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c061bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.407799:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c061c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.407817:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c061c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.407824:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c061c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.407910:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c061cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.407918:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c061cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.407924:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c061cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789042995.407950:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789042995.407953:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789042995.407988:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c061cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.408000:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c061bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.408007:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c061bd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.408014:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c061bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.408020:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686600 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789042995.408025:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c061bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.408038:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c061bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.408062:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a44e19000) 00010000:00010000:1.0:1789042995.408065:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789042995.408070:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c061bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.408076:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c061bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.408091:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c061c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.408097:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c061c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.408103:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c061c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.408109:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686e00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789042995.408112:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c061c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.408118:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c061c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.408125:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffffa06a44e19500) 00010000:00010000:1.0:1789042995.408127:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789042995.408130:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c061c4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.408146:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c061c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.408194:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c061b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67691c expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.408208:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c061cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67691c expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.408215:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa06a44e19c00) 00010000:00010000:1.0:1789042995.408218:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789042995.408220:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41686800, rc 0) 00000100:00100000:1.0:1789042995.408287:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79c78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+11:10283:x1875947242416256:12345-192.168.203.17@tcp:101:bash.0 Request processed in 633us (1822us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042995.408295:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 39 00000100:00100000:3.0:1789042995.430111:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042995.430216:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242416512 00000100:00100000:0.0:1789042995.430226:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242416512 00000100:00100000:0.0:1789042995.430288:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 40 00000100:00100000:0.0:1789042995.430299:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+11:10283:x1875947242416512:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:0.0:1789042995.430319:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789042995.430340:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c061d2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676923 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.430496:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c061d9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.430556:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c061d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.430569:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c061d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.430624:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c061e0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.430632:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c061e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.430638:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c061e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789042995.431208:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1789042995.431372:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c061e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.431382:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c061e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.431390:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c061e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.431423:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c061d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.431441:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c061d9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.431448:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c061d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.431454:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a40031c00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789042995.431458:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c061d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.431466:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c061d9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.431479:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa06a44e19c00) 00010000:00010000:0.0:1789042995.431482:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789042995.431487:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c061d9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.431494:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c061d9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789042995.431508:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e52c526 reply state 000000003e0eb4b2 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c061e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042995.431561:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789042995.431592:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c061d2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676923 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.431607:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c061e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676923 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.431627:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a55221000) 00010000:00010000:0.0:1789042995.431629:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789042995.431631:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a40031600, rc 0) 00000100:00100000:0.0:1789042995.431714:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+14:10283:x1875947242416512:12345-192.168.203.17@tcp:101:bash.0 Request processed in 1416us (1612us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789042995.431722:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 40 00010000:00010000:0.0:1789042995.433967:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c061e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.433985:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c061e0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.433993:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c061e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.433999:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a40031000 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789042995.434004:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c061e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.434012:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c061e0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.434037:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa06a55221e00) 00010000:00010000:0.0:1789042995.434041:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789042995.434045:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c061e0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.434065:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c061e0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042995.438210:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042995.438464:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242416640 00000100:00100000:1.0:1789042995.438474:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242416640 00000100:00100000:1.0:1789042995.438599:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 20 00000100:00100000:1.0:1789042995.438608:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1875947242416640:12345-192.168.203.17@tcp:8:bash.0 00010000:00080000:1.0:1789042995.438640:0:6691:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3fb32839-ebfd-4c0f-90e4-f036c86704df@192.168.203.17@tcp t0 exp 0000000000000000 cur 338 last 0 00000020:00000080:1.0:1789042995.438690:0:6691:0:(genops.c:1393:class_connect()) connect: client 3fb32839-ebfd-4c0f-90e4-f036c86704df, cookie 0x99260d7389c061f5 00002000:00100000:1.0:1789042995.438702:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3fb32839-ebfd-4c0f-90e4-f036c86704df/ffffa06a764ed000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789042995.438725:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789042995.438988:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789042995.439073:0:6691:0:(import.c:65:import_set_state_nolock()) ffffa06a764ee000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789042995.439137:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2348:x1875947242416640:12345-192.168.203.17@tcp:8:bash.0 Request processed in 528us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042995.439145:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 20 00000100:00100000:3.0:1789042995.445066:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042995.445172:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242416768 00000100:00100000:0.0:1789042995.445183:0:8215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242416768 00000100:00100000:0.0:1789042995.445258:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 21 00000100:00100000:0.0:1789042995.445269:0:8215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:0:x1875947242416768:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:0.0:1789042995.445288:0:8215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789042995.445313:0:8215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a24a1ae0/0x99260d7389c061fc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca67692a expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789042995.445343:0:8215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789042995.445363:0:8215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=338s v=(0 0) 00010000:00010000:0.0:1789042995.445368:0:8215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789042995.445378:0:8215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a24a1ae0/0x99260d7389c061fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67692a expref: 7 pid: 8215 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.445397:0:8215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a24a1ae0/0x99260d7389c061fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67692a expref: 7 pid: 8215 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.445411:0:8215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a40031000, rc 0) 00000100:00080000:2.0:1789042995.445553:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789042995.446379:0:8215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:0:x1875947242416768:12345-192.168.203.17@tcp:101:bash.0 Request processed in 1108us (1326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042995.446388:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 21 00000100:00100000:1.0:1789042995.449281:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042995.449630:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242416896 00000100:00100000:2.0:1789042995.449640:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242416896 00000100:00100000:2.0:1789042995.449702:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 22 00000100:00100000:2.0:1789042995.449712:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5289ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:10283:x1875947242416896:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:2.0:1789042995.449729:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789042995.449751:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f52dbeaf/0x99260d7389c06203 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676931 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.449785:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a24a1ae0/0x99260d7389c061fc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67692a expref: 8 pid: 8215 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.449793:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789042995.449797:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789042995.449803:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f52dbeaf/0x99260d7389c06203 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676931 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.449841:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a24a1ae0/0x99260d7389c061fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67692a expref: 8 pid: 8215 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.449863:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a24a1ae0/0x99260d7389c061fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67692a expref: 8 pid: 8215 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042995.449878:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a79c7b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6690:1875947267620352:192.168.203.17@tcp:104: 00000100:00100000:2.0:1789042995.449977:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a42ee4180 going to sleep for 11 seconds 00000100:00100000:3.0:1789042995.452310:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042995.452439:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a79c7b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6690:1875947267620352:192.168.203.17@tcp:104: 00010000:00010000:2.0:1789042995.452473:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f52dbeaf/0x99260d7389c06203 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676931 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.452495:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50979200, rc 0) 00000100:00100000:2.0:1789042995.452596:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5289ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:10283:x1875947242416896:12345-192.168.203.17@tcp:101:bash.0 Request processed in 2885us (3324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042995.452605:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 22 00000100:00100000:0.0:1789042995.453003:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242417024 00000100:00100000:0.0:1789042995.453010:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242417024 00010000:00010000:0.0:1789042995.453042:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a24a1ae0/0x99260d7389c061fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67692a expref: 8 pid: 8215 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042995.453103:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 35 00000100:00100000:0.0:1789042995.453113:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:2350:x1875947242417024:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789042995.453127:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789042995.453151:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a24a1ae0/0x99260d7389c061fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67692a expref: 8 pid: 8215 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.453163:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a24a1ae0/0x99260d7389c061fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67692a expref: 8 pid: 8215 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.453186:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a24a1ae0/0x99260d7389c061fc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67692a expref: 8 pid: 8215 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.453201:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789042995.453205:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789042995.453213:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f52dbeaf/0x99260d7389c06203 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676931 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.453223:0:8457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f52dbeaf/0x99260d7389c06203 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676931 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.453254:0:8457:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f52dbeaf/0x99260d7389c06203 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676931 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042995.453267:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767da680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8457:1875947267620480:192.168.203.17@tcp:105: 00000100:00100000:0.0:1789042995.453338:0:8457:0:(client.c:2716:ptlrpc_set_wait()) set ffffa069435559c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789042995.459061:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767da680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8457:1875947267620480:192.168.203.17@tcp:105: 00010000:00010000:0.0:1789042995.459087:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789042995.459146:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2350:x1875947242417024:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 6034us (6841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042995.459156:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 35 00000100:00100000:3.0:1789042995.459782:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042995.459981:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242417280 00000100:00100000:0.0:1789042995.459989:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242417280 00000100:00100000:0.0:1789042995.460095:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 6 00000100:00100000:0.0:1789042995.460106:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+13:10283:x1875947242417280:12345-192.168.203.17@tcp:35:bash.0 00000100:00100000:0.0:1789042995.460466:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+14:10283:x1875947242417280:12345-192.168.203.17@tcp:35:bash.0 Request processed in 361us (687us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789042995.460475:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 6 00000100:00100000:1.0:1789042995.511824:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042995.511985:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242417536 00000100:00100000:0.0:1789042995.511996:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242417536 00000100:00100000:0.0:1789042995.512060:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 41 00000100:00100000:0.0:1789042995.512072:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5289f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+14:10293:x1875947242417536:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:0.0:1789042995.512096:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789042995.512116:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c0620a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676938 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789042995.512201:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789042995.512334:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c0620a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676938 expref: 16 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.512348:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a44e19000) 00010000:00010000:0.0:1789042995.512367:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789042995.512373:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c0620a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676938 expref: 16 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.512393:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a40031000, rc 0) 00000100:00100000:0.0:1789042995.512458:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5289f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+15:10293:x1875947242417536:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 389us (645us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1789042995.512465:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 41 00000100:00100000:3.0:1789042995.522368:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042995.522484:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242417792 00000100:00100000:1.0:1789042995.522495:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242417792 00000100:00100000:1.0:1789042995.522874:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 7 00000100:00100000:1.0:1789042995.522886:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+15:10293:x1875947242417792:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:1.0:1789042995.523149:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+16:10293:x1875947242417792:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 264us (790us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789042995.523156:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 7 00010000:00010000:2.0:1789042995.574118:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789042995.660356:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042995.660677:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242417920 00000100:00100000:2.0:1789042995.660688:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242417920 00000100:00100000:2.0:1789042995.660759:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 42 00000100:00100000:2.0:1789042995.660770:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+16:10299:x1875947242417920:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:2.0:1789042995.660793:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789042995.660816:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06218 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca67693f expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.660888:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c0621f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.660922:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c0621f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.660935:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c0621f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789042995.660966:0:11703:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789042995.660969:0:11703:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789042995.660986:0:11703:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c0621f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.661010:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06218 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67693f expref: 18 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.661029:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c0621f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67693f expref: 17 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.661037:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa06a44e19c00) 00010000:00010000:2.0:1789042995.661040:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789042995.661044:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50978800, rc 0) 00000100:00100000:2.0:1789042995.661109:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+17:10299:x1875947242417920:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 341us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042995.661116:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 42 00000100:00100000:2.0:1789042995.676468:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042995.676576:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242418176 00000100:00100000:0.0:1789042995.676588:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242418176 00000100:00100000:0.0:1789042995.676651:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 43 00000100:00100000:0.0:1789042995.676663:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79c7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+17:10299:x1875947242418176:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:0.0:1789042995.676682:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789042995.676703:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06226 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676946 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.676819:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c0622d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.676832:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c0622d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.676843:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c0622d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789042995.676853:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789042995.676982:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06226 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676946 expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.677020:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c0622d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676946 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.677029:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a55221000) 00010000:00010000:0.0:1789042995.677032:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789042995.677035:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a40031c00, rc 0) 00000100:00100000:0.0:1789042995.677116:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79c7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+19:10299:x1875947242418176:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 455us (659us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1789042995.677123:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 43 00000100:00100000:3.0:1789042995.691247:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042995.691295:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042995.691403:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242418432 00000100:00100000:0.0:1789042995.691413:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242418432 00000100:00100000:0.0:1789042995.691471:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 44 00000100:00100000:0.0:1789042995.691482:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+19:10299:x1875947242418432:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:0.0:1789042995.691506:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789042995.691564:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c0623b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca67694d expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.691661:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06242 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.691677:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06242 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.691689:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06242 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789042995.691701:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789042995.691864:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c0623b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67694d expref: 22 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.691883:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06242 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67694d expref: 21 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.691891:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a55221000) 00010000:00010000:0.0:1789042995.691894:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789042995.691898:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a40031a00, rc 0) 00000100:00100000:0.0:1789042995.691955:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+21:10299:x1875947242418432:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 475us (718us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789042995.691963:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 44 00000100:00100000:0.0:1789042995.699124:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042995.702731:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242418688 00000100:00100000:2.0:1789042995.702756:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242418688 00000100:00100000:2.0:1789042995.702816:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 23 00000100:00100000:2.0:1789042995.702826:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2349:x1875947242418688:12345-192.168.203.17@tcp:1:lfs.0 00010000:00010000:2.0:1789042995.702880:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6e21066/0x99260d7389c06250 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.702902:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f52dbeaf/0x99260d7389c06203 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676931 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.702912:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789042995.702916:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789042995.702921:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6e21066/0x99260d7389c06250 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.702959:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f52dbeaf/0x99260d7389c06203 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676931 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.702974:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f52dbeaf/0x99260d7389c06203 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676931 expref: 7 pid: 6690 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042995.702989:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a79c7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6692:1875947267620608:192.168.203.17@tcp:104: 00000100:00100000:2.0:1789042995.703088:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a42ee4180 going to sleep for 11 seconds 00000100:00100000:1.0:1789042995.704845:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242418560 00000100:00100000:1.0:1789042995.704857:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242418560 00000100:00100000:1.0:1789042995.704914:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 2 00000100:00100000:1.0:1789042995.704924:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+21:2350:x1875947242418560:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789042995.704939:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789042995.704962:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c0622d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676946 expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.704979:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a55221000) 00010000:00010000:1.0:1789042995.704984:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789042995.705036:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+20:2350:x1875947242418560:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 114us (13740us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042995.705043:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 2 00000100:00100000:1.0:1789042995.706024:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a79c7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6692:1875947267620608:192.168.203.17@tcp:104: 00010000:00010000:1.0:1789042995.706064:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6e21066/0x99260d7389c06250 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042995.711333:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042995.711437:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242418816 00000100:00100000:1.0:1789042995.711460:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242418816 00002000:00100000:1.0:1789042995.711510:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffffa06a79c79c00 x1875947242418816/t0(0) o4->3fb32839-ebfd-4c0f-90e4-f036c86704df@192.168.203.17@tcp:291/0 lens 504/0 e 0 to 0 dl 1789043006 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789042995.711565:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa06a79c79c00 with x1875947242418816 ext(0->12) 00010000:00010000:1.0:1789042995.711574:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f52dbeaf/0x99260d7389c06203 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676931 expref: 8 pid: 6690 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.711593:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f52dbeaf/0x99260d7389c06203 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676931 expref: 8 pid: 6690 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789042995.711602:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa06a79c79c00 00000100:00100000:1.0:1789042995.711634:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 0 00000100:00100000:1.0:1789042995.711644:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79c79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:2351:x1875947242418816:12345-192.168.203.17@tcp:4:lfs.0 00000001:00100000:2.0:1789042995.793682:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3fb32839-ebfd-4c0f-90e4-f036c86704df 00000100:00100000:2.0:1789042995.796401:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79c79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+9:2351:x1875947242418816:12345-192.168.203.17@tcp:4:lfs.0 Request processed in 84461us (84781us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789042995.796429:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 0 00002000:00100000:2.0:1789042995.796449:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffffa06a79c79c00 x1875947242418816/t4294967299(0) o4->3fb32839-ebfd-4c0f-90e4-f036c86704df@192.168.203.17@tcp:291/0 lens 504/448 e 0 to 0 dl 1789043006 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789042995.796485:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa06a79c79c00 with x1875947242418816 ext(0->12) 00010000:00010000:2.0:1789042995.796500:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f52dbeaf/0x99260d7389c06203 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676931 expref: 9 pid: 6690 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.796774:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f52dbeaf/0x99260d7389c06203 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676931 expref: 9 pid: 6690 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789042995.796785:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa06a79c79c00 00000100:00100000:0.0:1789042995.801796:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042995.801948:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242418944 00000100:00100000:2.0:1789042995.801959:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242418944 00010000:00010000:2.0:1789042995.802005:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f52dbeaf/0x99260d7389c06203 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676931 expref: 9 pid: 6690 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042995.802058:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 36 00000100:00100000:2.0:1789042995.802068:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a453a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+9:2350:x1875947242418944:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789042995.802081:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789042995.802104:0:5833:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789042995.802107:0:5833:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789042995 00002000:00010000:2.0:1789042995.802109:0:5833:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789042995 00002000:00010000:2.0:1789042995.802111:0:5833:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789042995 00010000:00010000:2.0:1789042995.802117:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f52dbeaf/0x99260d7389c06203 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676931 expref: 9 pid: 6690 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.802130:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f52dbeaf/0x99260d7389c06203 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676931 expref: 9 pid: 6690 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.802177:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f52dbeaf/0x99260d7389c06203 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676931 expref: 9 pid: 6690 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.802196:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789042995.802202:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789042995.802208:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6e21066/0x99260d7389c06250 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.802219:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6e21066/0x99260d7389c06250 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.804132:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789042995.804208:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a453a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:2350:x1875947242418944:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 2135us (2417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042995.804219:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 36 00010000:00010000:3.0:1789042995.805650:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6e21066/0x99260d7389c06250 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042995.805667:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6e21066/0x99260d7389c06250 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042995.805706:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6e21066/0x99260d7389c06250 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042995.805731:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6e21066/0x99260d7389c06250 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042995.805738:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6e21066/0x99260d7389c06250 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042995.805745:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50978e00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:3.0:1789042995.805749:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6e21066/0x99260d7389c06250 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042995.805758:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6e21066/0x99260d7389c06250 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042995.805778:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6e21066/0x99260d7389c06250 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042995.805786:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6e21066/0x99260d7389c06250 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042995.805860:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:2349:x1875947242418688:12345-192.168.203.17@tcp:1:lfs.0 Request processed in 103032us (106743us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042995.805870:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 23 00000100:00100000:3.0:1789042995.812974:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042995.819414:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242419200 00000100:00100000:0.0:1789042995.819429:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242419200 00000100:00100000:0.0:1789042995.820416:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 8 00000100:00100000:0.0:1789042995.820436:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+20:10299:x1875947242419200:12345-192.168.203.17@tcp:35:lfs.0 00000004:00010000:0.0:1789042995.820493:0:5848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06242 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67694d expref: 20 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789042995.821160:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1789042995.821365:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1789042995.822811:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1789042995.822891:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06257 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.822912:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c061e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676923 expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.822921:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06257 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.822960:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c061e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676923 expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.822987:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c061e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676923 expref: 24 pid: 5846 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042995.823002:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a79c79180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1875947267620736:192.168.203.17@tcp:104: 00000100:00100000:2.0:1789042995.823112:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a42ee4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789042995.841338:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042995.841430:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a79c79180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1875947267620736:192.168.203.17@tcp:104: 00000100:00100000:0.0:1789042995.841857:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242419328 00000100:00100000:0.0:1789042995.841866:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242419328 00010000:00010000:0.0:1789042995.841912:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c061e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676923 expref: 25 pid: 5846 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042995.841978:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 37 00000100:00100000:0.0:1789042995.841989:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79c7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+25:2351:x1875947242419328:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789042995.842006:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789042995.842014:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c061e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676923 expref: 25 pid: 5846 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.842026:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c061e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676923 expref: 25 pid: 5846 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.842061:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c061e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676923 expref: 25 pid: 5846 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.842079:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a55221000) 00010000:00010000:0.0:1789042995.842084:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06257 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.842094:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06257 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.842101:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06257 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042995.842123:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789042995.842192:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79c7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+24:2351:x1875947242419328:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 204us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042995.842201:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 37 00010000:00010000:2.0:1789042995.843603:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06257 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.843618:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06257 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.843624:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06257 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789042995.843773:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1789042995.843986:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1789042995.844139:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a79c79180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1875947267620864:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789042995.844198:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042995.844246:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a42ee43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789042995.844363:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267620864 00000100:00100000:3.0:1789042995.844388:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267620864 00000100:00100000:3.0:1789042995.844506:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789042995.844549:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79c78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1875947267620864:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789042995.844682:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79c78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1875947267620864:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 165us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042995.844691:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789042995.845114:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789042995.845161:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a79c79180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1875947267620864:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789042995.847073:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1789042995.847161:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a79c79180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1875947267620992:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789042995.847223:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042995.847450:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a42ee4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789042995.850916:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267620992 00000100:00100000:3.0:1789042995.850928:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267620992 00000100:00100000:3.0:1789042995.851000:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789042995.851011:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79c79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1875947267620992:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789042995.851722:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79c79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5848:x1875947267620992:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 709us (4494us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789042995.851732:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789042995.852035:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a79c79180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1875947267620992:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789042995.853003:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1789042995.853069:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06257 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.853081:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06257 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.853089:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06257 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.853095:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789042995.853100:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06257 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.853107:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06257 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.853124:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a55221000) 00010000:00010000:2.0:1789042995.853127:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789042995.853132:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06257 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042995.853138:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06257 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789042995.860367:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789042995.860647:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1789042995.860661:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 338817145845ns, next at 339817142321ns, rc = 0 00000001:00080000:2.0:1789042995.860671:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1789042995.860738:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a55221000) 00010000:00010000:2.0:1789042995.860756:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789042995.860767:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06242 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67694d expref: 28 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042995.860896:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+27:10299:x1875947242419200:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 40465us (47931us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1789042995.860912:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 8 00000020:00080000:2.0:1789042995.860919:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789042995.869325:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042995.870087:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242419456 00000100:00100000:1.0:1789042995.870105:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242419456 00000100:00100000:1.0:1789042995.870176:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 45 00000100:00100000:1.0:1789042995.870187:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+27:10299:x1875947242419456:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1789042995.870215:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789042995.870239:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c0625e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676954 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.870319:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c0625e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676954 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.870335:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c0625e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676954 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042995.870379:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:1.0:1789042995.870383:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789042995.870387:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41687e00, rc 0) 00000100:00100000:1.0:1789042995.870459:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+28:10299:x1875947242419456:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 273us (1152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042995.870465:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 45 00000100:00100000:1.0:1789042995.876323:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042995.876504:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242419712 00000100:00100000:3.0:1789042995.876556:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242419712 00000100:00100000:3.0:1789042995.876613:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 9 00000100:00100000:3.0:1789042995.876623:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a50c23450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+28:10299:x1875947242419712:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:3.0:1789042995.876885:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a50c23450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+29:10299:x1875947242419712:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 262us (570us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1789042995.876893:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 9 00000100:00100000:3.0:1789042996.027691:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042996.027865:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242419968 00000100:00100000:1.0:1789042996.027876:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242419968 00000100:00100000:1.0:1789042996.027981:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 46 00000100:00100000:1.0:1789042996.027992:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+29:10309:x1875947242419968:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1789042996.028017:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789042996.028038:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06265 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca67695b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789042996.028145:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1789042996.028272:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06265 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67695b expref: 31 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.029410:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a44e19000) 00010000:00010000:1.0:1789042996.029416:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789042996.029426:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06265 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67695b expref: 31 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.029443:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41687000, rc 0) 00000100:00100000:1.0:1789042996.029565:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+30:10309:x1875947242419968:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 1574us (1883us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1789042996.029587:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 46 00000100:00100000:2.0:1789042996.035863:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042996.035967:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242420096 00000100:00100000:1.0:1789042996.035978:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242420096 00000100:00100000:1.0:1789042996.036084:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 47 00000100:00100000:1.0:1789042996.036095:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+30:10309:x1875947242420096:12345-192.168.203.17@tcp:34:lfs.0 00010000:00010000:1.0:1789042996.036173:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06273 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.036190:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06273 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.036202:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06273 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.036217:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c0627a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.036223:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c0627a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.036230:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c0627a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.036325:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06281 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.036333:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06281 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.036340:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06281 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789042996.036398:0:11703:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06281 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.036410:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06273 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.036416:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06273 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.036422:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06273 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.036429:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687000 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789042996.036433:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06273 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.036440:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06273 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.036451:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa06a44e19c00) 00010000:00010000:1.0:1789042996.036454:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789042996.036458:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06273 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.036464:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06273 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.036476:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c0627a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.036481:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c0627a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.036493:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c0627a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.036498:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687400 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789042996.036503:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c0627a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.036509:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c0627a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.036570:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa06a44e19500) 00010000:00010000:1.0:1789042996.036573:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789042996.036577:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c0627a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.036582:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c0627a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.036605:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06281 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.036611:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06281 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.036616:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06281 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.036621:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789042996.036624:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06281 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.036638:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06281 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.036646:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:1.0:1789042996.036648:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789042996.036650:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06281 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.036655:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06281 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042996.036726:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+30:10309:x1875947242420096:12345-192.168.203.17@tcp:34:lfs.0 Request processed in 633us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042996.036733:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 47 00000100:00100000:3.0:1789042996.039173:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042996.039247:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242420352 00000100:00100000:2.0:1789042996.039257:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242420352 00000100:00100000:2.0:1789042996.039333:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00100000:2.0:1789042996.039343:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+30:10309:x1875947242420352:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:2.0:1789042996.039574:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+31:10309:x1875947242420352:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 232us (409us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1789042996.039582:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00100000:3.0:1789042996.070674:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042996.071002:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242420608 00000100:00100000:0.0:1789042996.071024:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242420608 00000100:00100000:0.0:1789042996.071182:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 48 00000100:00100000:0.0:1789042996.071195:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+31:10312:x1875947242420608:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:0.0:1789042996.071225:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789042996.071255:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06288 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676962 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042996.071350:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0200/0x99260d7389c0628f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042996.071366:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0200/0x99260d7389c0628f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042996.071382:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0200/0x99260d7389c0628f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042996.071397:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c06296 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042996.071405:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c06296 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042996.071412:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c06296 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042996.071601:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c0629d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042996.071611:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c0629d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042996.071619:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c0629d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789042996.071636:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789042996.071735:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0200/0x99260d7389c0628f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042996.071743:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0200/0x99260d7389c0628f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042996.071750:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0200/0x99260d7389c0628f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042996.071756:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a413a0200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789042996.071761:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0200/0x99260d7389c0628f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042996.071768:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0200/0x99260d7389c0628f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042996.071780:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa06a44e19c00) 00010000:00010000:0.0:1789042996.071784:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789042996.071789:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0200/0x99260d7389c0628f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042996.071796:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0200/0x99260d7389c0628f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042996.071809:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c06296 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042996.071816:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c06296 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042996.071833:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c06296 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042996.071838:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a413a0800 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789042996.071841:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c06296 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042996.071848:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c06296 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042996.071856:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa06a55221700) 00010000:00010000:0.0:1789042996.071858:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789042996.071862:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c06296 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042996.071867:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c06296 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042996.071913:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06288 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676962 expref: 34 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042996.071926:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c0629d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676962 expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042996.071934:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:0.0:1789042996.071936:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789042996.071939:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a413a0600, rc 0) 00000100:00100000:0.0:1789042996.072011:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+33:10312:x1875947242420608:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 819us (1342us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1789042996.072028:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 48 00000100:00100000:0.0:1789042996.075750:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042996.076255:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242420736 00000100:00100000:1.0:1789042996.076265:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242420736 00000100:00100000:1.0:1789042996.076382:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 49 00000100:00100000:1.0:1789042996.076393:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75ede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+33:10312:x1875947242420736:12345-192.168.203.17@tcp:54:lfs.0 00010000:00010000:1.0:1789042996.076457:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c062ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.076475:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c062ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.076486:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c062ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.076553:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c062ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.076578:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c062ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.076584:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c062ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.076591:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789042996.076595:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c062ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.076603:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c062ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.076616:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:1.0:1789042996.076619:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789042996.076625:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c062ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.076632:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c062ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042996.076698:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75ede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+33:10312:x1875947242420736:12345-192.168.203.17@tcp:54:lfs.0 Request processed in 307us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042996.076706:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 49 00000100:00100000:3.0:1789042996.080306:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042996.080437:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242420992 00000100:00100000:1.0:1789042996.080452:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242420992 00000100:00100000:1.0:1789042996.080504:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00100000:1.0:1789042996.080678:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+33:10312:x1875947242420992:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:1.0:1789042996.080973:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+34:10312:x1875947242420992:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 459us (687us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1789042996.080988:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00100000:3.0:1789042996.422692:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042996.423911:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242421248 00000100:00100000:1.0:1789042996.423930:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242421248 00000100:00100000:1.0:1789042996.424051:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 50 00000100:00100000:1.0:1789042996.424066:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+34:10343:x1875947242421248:12345-192.168.203.17@tcp:101:cat.0 00010000:00010000:1.0:1789042996.424105:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789042996.424135:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c062b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676969 expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.424286:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c062b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.424304:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c062b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.424319:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c062b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789042996.424335:0:11703:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789042996.424601:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c062b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676969 expref: 37 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.424626:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c062b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676969 expref: 36 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.424635:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:1.0:1789042996.424639:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789042996.424643:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41687400, rc 0) 00000100:00100000:1.0:1789042996.425449:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+36:10343:x1875947242421248:12345-192.168.203.17@tcp:101:cat.0 Request processed in 1381us (2768us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1789042996.425460:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 50 00000100:00100000:3.0:1789042996.432477:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042996.432628:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042996.432711:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242421632 00000100:00100000:3.0:1789042996.432725:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242421632 00000100:00100000:3.0:1789042996.433034:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 3 00000100:00100000:3.0:1789042996.433063:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46f89850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+36:2349:x1875947242421632:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789042996.433087:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789042996.433121:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c062b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676969 expref: 36 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042996.433148:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:3.0:1789042996.433154:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789042996.433212:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46f89850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+35:2349:x1875947242421632:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 168us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042996.433219:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 3 00000100:00100000:1.0:1789042996.434172:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242421504 00000100:00100000:1.0:1789042996.434188:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242421504 00000100:00100000:1.0:1789042996.434264:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 12 00000100:00100000:1.0:1789042996.434275:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+35:10343:x1875947242421504:12345-192.168.203.17@tcp:35:cat.0 00000100:00100000:1.0:1789042996.434678:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+36:10343:x1875947242421504:12345-192.168.203.17@tcp:35:cat.0 Request processed in 404us (2216us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1789042996.434686:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 12 00000100:00100000:3.0:1789042996.467061:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a763c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267621376:0@lo:400:kworker.0 00000100:00100000:3.0:1789042996.467170:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042996.467262:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789042996.467269:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a763c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267621504:0@lo:400:kworker.0 00000100:00100000:3.0:1789042996.467298:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042996.467339:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267621504 00000100:00100000:3.0:1789042996.467349:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267621504 00000100:00100000:3.0:1789042996.467414:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789042996.467426:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1875947267621504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042996.467491:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1875947267621504:12345-0@lo:400:kworker.0 Request processed in 66us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042996.467499:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789042996.467589:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a763c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267621504:0@lo:400:kworker.0 00000100:00100000:0.0:1789042996.467774:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a763c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267621120:0@lo:400:kworker.0 00000100:00100000:0.0:1789042996.467819:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042996.467859:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a763cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875947267621632:0@lo:400:kworker.0 00000100:00100000:0.0:1789042996.467885:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042996.467912:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789042996.467919:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a763c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875947267621248:0@lo:400:kworker.0 00000100:00100000:0.0:1789042996.467940:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042996.467955:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a763cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267621760:0@lo:400:kworker.0 00000100:00100000:0.0:1789042996.467974:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042996.468002:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267621376 00000100:00100000:0.0:1789042996.468007:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267621376 00000100:00100000:0.0:1789042996.468058:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267621632 00000100:00100000:0.0:1789042996.468061:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267621632 00000100:00100000:0.0:1789042996.468082:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267621248 00000100:00100000:0.0:1789042996.468085:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267621248 00000100:00100000:0.0:1789042996.468101:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789042996.468109:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267621376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789042996.468154:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267621376:12345-0@lo:400:kworker.0 Request processed in 46us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042996.468162:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789042996.468177:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789042996.468183:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75edfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875947267621632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789042996.468229:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75edfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875947267621632:12345-0@lo:400:kworker.0 Request processed in 47us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042996.468244:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789042996.468255:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789042996.468261:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75edf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875947267621248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789042996.468287:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75edf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875947267621248:12345-0@lo:400:kworker.0 Request processed in 27us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042996.468292:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:0.0:1789042996.468309:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789042996.468332:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a763c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875947267621248:0@lo:400:kworker.0 00000100:00100000:0.0:1789042996.468341:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a763cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875947267621632:0@lo:400:kworker.0 00000100:00100000:0.0:1789042996.468365:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267621760 00000100:00100000:0.0:1789042996.468368:0:8215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267621760 00000100:00100000:0.0:1789042996.468409:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789042996.468416:0:8215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75edc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267621760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789042996.468453:0:8215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75edc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267621760:12345-0@lo:400:kworker.0 Request processed in 37us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042996.468459:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1789042996.468473:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789042996.468490:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a763cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267621760:0@lo:400:kworker.0 00000100:00100000:0.0:1789042996.468540:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a763c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267621376:0@lo:400:kworker.0 00000100:00100000:3.0:1789042996.469067:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267621120 00000100:00100000:3.0:1789042996.469074:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267621120 00000100:00100000:3.0:1789042996.469116:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1789042996.469124:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3312:x1875947267621120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789042996.469180:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3312:x1875947267621120:12345-0@lo:400:kworker.0 Request processed in 57us (1360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042996.469186:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1789042996.470974:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a763c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267621120:0@lo:400:kworker.0 00000100:00100000:0.0:1789042996.545492:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042996.545754:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242421888 00000100:00100000:1.0:1789042996.545764:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242421888 00000100:00100000:1.0:1789042996.545828:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 51 00000100:00100000:1.0:1789042996.545838:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+36:10349:x1875947242421888:12345-192.168.203.17@tcp:101:dd.0 00010000:00010000:1.0:1789042996.545866:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789042996.545870:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789042996.545900:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c0621f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67693f expref: 36 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.545921:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa06a44e19c00) 00010000:00010000:1.0:1789042996.545926:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789042996.545938:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c062c7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676970 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.546031:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c062ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.546065:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c0629d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676962 expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.546075:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c062ce lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.546115:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c0629d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676962 expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.546128:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c0629d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676962 expref: 36 pid: 5846 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042996.546143:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a5289c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875947267621888:192.168.203.17@tcp:104: 00000100:00100000:1.0:1789042996.546226:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a6ed9d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789042996.554555:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042996.554587:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242422016 00000100:00100000:1.0:1789042996.554596:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242422016 00000100:00100000:3.0:1789042996.555163:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a5289c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875947267621888:192.168.203.17@tcp:104: 00010000:00010000:3.0:1789042996.555188:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c062ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.556090:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c0629d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676962 expref: 37 pid: 5846 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042996.556128:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 38 00000100:00100000:1.0:1789042996.556143:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5289e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+37:2351:x1875947242422016:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789042996.556157:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789042996.556163:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c0629d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676962 expref: 37 pid: 5846 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.556194:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c0629d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676962 expref: 37 pid: 5846 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.556216:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c0629d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676962 expref: 37 pid: 5846 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.556232:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:1.0:1789042996.556237:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c062ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.556246:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c062ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.556254:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c062ce lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042996.556283:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789042996.556334:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5289e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+36:2351:x1875947242422016:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 198us (1790us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042996.556342:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 38 00000001:00080000:0.0:1789042996.561405:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967329 is committed 00000001:00080000:0.0:1789042996.561438:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967332 is committed 00000004:00080000:0.0:1789042996.561457:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:0.0:1789042996.561481:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa06a42ee43c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1789042996.561499:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa06a5852e000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa06a42ee4a80 00000020:00080000:0.0:1789042996.561502:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa06a5852e700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa06a6f006000 00000020:00080000:0.0:1789042996.561557:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1789042996.561681:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1789042996.561966:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789042996.561989:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a79c7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267622016:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789042996.562096:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042996.562161:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267622016 00000100:00100000:2.0:1789042996.562169:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267622016 00000100:00100000:2.0:1789042996.562216:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789042996.562225:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52dfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3315:x1875947267622016:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789042996.562256:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1789042996.562294:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa2a133, atime: 0x6aa2a133, ctime: 0x6aa2a133, blocks: 0x1 00010000:00010000:2.0:1789042996.562309:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a7b6f9/0x99260d7389c062d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042996.562327:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1789042996.562332:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789042996.562340:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010a7b6f9/0x99260d7389c062d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042996.562361:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010a7b6f9/0x99260d7389c062d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042996.562373:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010a7b6f9/0x99260d7389c062d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042996.562381:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010a7b6f9/0x99260d7389c062d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042996.562398:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789042996.562913:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52dfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3315:x1875947267622016:12345-0@lo:6:osp-syn-0-0.0 Request processed in 687us (815us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789042996.562921:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1789042996.562954:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789042996.562961:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010a7b6f9/0x99260d7389c062d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042996.562970:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979000 already unused, calling callback (ffffffffc1470760) 00010000:00010000:2.0:1789042996.562975:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a7b6f9/0x99260d7389c062d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042996.562993:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010a7b6f9/0x99260d7389c062d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042996.563010:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010a7b6f9/0x99260d7389c062d5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042996.563018:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010a7b6f9/0x99260d7389c062d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042996.563036:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789042996.563038:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789042996.563052:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789042996.563084:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa06a79c7a680/2, rc 0, transno 4294967301 00000100:00100000:2.0:1789042996.563091:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a79c7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267622016:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789042996.563730:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c062ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042996.563740:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c062ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789042996.563759:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789042996.563966:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c062c7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676970 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042996.563985:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c062ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676970 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042996.563994:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:3.0:1789042996.563997:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789042996.564000:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41687000, rc 0) 00000100:00100000:3.0:1789042996.564069:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+12:10349:x1875947242421888:12345-192.168.203.17@tcp:101:dd.0 Request processed in 18232us (18585us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1789042996.564085:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 51 00000100:00100000:1.0:1789042996.570753:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042996.571838:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242422272 00000100:00100000:2.0:1789042996.571849:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242422272 00000100:00100000:2.0:1789042996.571913:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 52 00000100:00100000:2.0:1789042996.571924:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5289f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+12:10349:x1875947242422272:12345-192.168.203.17@tcp:36:dd.0 00010000:00010000:2.0:1789042996.572466:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979000/0x99260d7389c062e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042996.572485:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979000/0x99260d7389c062e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042996.572497:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979000/0x99260d7389c062e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789042996.572594:0:6714:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1789042996.572622:0:6714:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e930d5ae reply state 00000000ebccccc8 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979000/0x99260d7389c062e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042996.572630:0:6714:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789042996.572733:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5289f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+15:10349:x1875947242422272:12345-192.168.203.17@tcp:36:dd.0 Request processed in 808us (1989us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1789042996.572740:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 52 00000020:00080000:2.0:1789042996.572746:0:6714:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789042996.584667:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979000/0x99260d7389c062e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042996.584686:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979000/0x99260d7389c062e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042996.584693:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979000/0x99260d7389c062e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042996.584700:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979000 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789042996.584705:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979000/0x99260d7389c062e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042996.584713:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979000/0x99260d7389c062e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042996.584732:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:3.0:1789042996.584735:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789042996.584741:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979000/0x99260d7389c062e3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042996.584747:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979000/0x99260d7389c062e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042996.597739:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789042996.979367:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789042996.979391:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267622144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789042996.979456:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789042996.980115:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267622144 00000100:00100000:3.0:1789042996.980125:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267622144 00000100:00100000:3.0:1789042996.980184:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789042996.980195:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5289c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267622144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789042996.980243:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789042996.981625:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5289c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267622144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1425us (2161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042996.981635:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789042996.989952:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267622144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789042997.048421:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042997.048749:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242422400 00000100:00100000:2.0:1789042997.048760:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242422400 00000100:00080000:0.0:1789042997.048803:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789042997.048878:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 53 00000100:00100000:2.0:1789042997.048889:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5289df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+14:10364:x1875947242422400:12345-192.168.203.17@tcp:101:stat.0 00010000:00010000:2.0:1789042997.048914:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789042997.048936:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979c00/0x99260d7389c062ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676977 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.049002:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c062f1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.049017:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c062f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.049031:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c062f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.049057:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c062f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.049078:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c062f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.049086:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c062f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.049396:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c062ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.049408:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c062ce lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676970 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.049415:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c062ff lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.049450:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c062ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676970 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.049462:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c062ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676970 expref: 15 pid: 5845 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042997.053802:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52dff800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1875947267622272:192.168.203.17@tcp:104: 00000100:00100000:2.0:1789042997.054288:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a42ee4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789042997.066808:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52dff800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1875947267622272:192.168.203.17@tcp:104: 00010000:00010000:2.0:1789042997.066840:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c062ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042997.079802:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042997.079969:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242422656 00000100:00100000:2.0:1789042997.079994:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242422656 00000100:00100000:2.0:1789042997.080064:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 13 00000100:00100000:2.0:1789042997.080076:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5289d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+16:5593:x1875947242422656:12345-192.168.203.17@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789042997.081641:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5289d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+17:5593:x1875947242422656:12345-192.168.203.17@tcp:35:ldlm_bl.0 Request processed in 1560us (1842us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1789042997.081653:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 13 00000100:00100000:1.0:1789042997.096129:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042997.096430:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242422784 00000100:00100000:3.0:1789042997.096449:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242422784 00010000:00010000:3.0:1789042997.096491:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c062ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676970 expref: 17 pid: 5845 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042997.096576:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 39 00000100:00100000:3.0:1789042997.096586:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5289ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+17:2352:x1875947242422784:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789042997.096599:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789042997.096606:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c062ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676970 expref: 17 pid: 5845 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.096620:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c062ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676970 expref: 17 pid: 5845 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.096640:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c062ce lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676970 expref: 17 pid: 5845 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.096655:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:3.0:1789042997.096660:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c062ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.096670:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c062ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.096689:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c062ff lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.096721:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789042997.096770:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5289ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+16:2352:x1875947242422784:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 186us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042997.096778:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 39 00010000:00010000:1.0:1789042997.096915:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c062ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.096924:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c062ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789042997.096970:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789042997.096974:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789042997.097013:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c062ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.097026:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c062ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.097036:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c062f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.097054:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c062f1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.097060:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c062f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.097066:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979a00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789042997.097070:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c062f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.097078:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c062f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.097088:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa06a44e19c00) 00010000:00010000:1.0:1789042997.097091:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789042997.097095:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c062f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.097108:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c062f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.097119:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c062f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.097125:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c062f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.097131:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c062f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.097135:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979600 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789042997.097138:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c062f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.097144:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c062f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.097151:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa06a457d3200) 00010000:00010000:1.0:1789042997.097154:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789042997.097156:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c062f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.097161:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c062f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.097200:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979c00/0x99260d7389c062ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676977 expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.097212:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c062ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676977 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.097224:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:1.0:1789042997.097227:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789042997.097229:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50979800, rc 0) 00000100:00100000:1.0:1789042997.097254:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5289df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+16:10364:x1875947242422400:12345-192.168.203.17@tcp:101:stat.0 Request processed in 48367us (48910us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042997.097261:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 53 00000100:00100000:0.0:1789042997.250697:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042997.252308:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242423040 00000100:00100000:3.0:1789042997.252319:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242423040 00000100:00100000:3.0:1789042997.252379:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 54 00000100:00100000:3.0:1789042997.252388:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+15:10370:x1875947242423040:12345-192.168.203.17@tcp:36:truncate.0 00010000:00010000:3.0:1789042997.252439:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789042997.252474:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c062ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676977 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.252492:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:3.0:1789042997.252497:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789042997.252907:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06306 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.252922:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06306 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.252933:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06306 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789042997.252984:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1789042997.253010:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009edc8f4f reply state 000000006f7f6e80 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06306 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042997.253032:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789042997.253159:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+17:10370:x1875947242423040:12345-192.168.203.17@tcp:36:truncate.0 Request processed in 770us (2472us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1789042997.253166:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 54 00000020:00080000:3.0:1789042997.253171:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789042997.259557:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06306 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.259574:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06306 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.259582:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06306 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.259589:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc29200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789042997.259594:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06306 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.259603:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06306 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.259620:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:1.0:1789042997.259623:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789042997.259628:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06306 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.259635:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06306 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042997.420876:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042997.421705:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242423168 00000100:00100000:2.0:1789042997.421719:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242423168 00000100:00100000:2.0:1789042997.421835:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 55 00000100:00100000:2.0:1789042997.421852:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+16:10384:x1875947242423168:12345-192.168.203.17@tcp:101:stat.0 00010000:00010000:2.0:1789042997.421888:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789042997.421917:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c0630d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca67697e expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.421999:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c06314 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.422016:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c06314 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.422029:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c06314 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.422055:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c0631b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.422063:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c0631b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.422070:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c0631b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.422413:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06322 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.422424:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06322 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.422431:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06322 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789042997.422475:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1789042997.422490:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789042997.422567:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06322 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.422584:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06322 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.422591:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c06314 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.422597:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c06314 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.422602:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c06314 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.422605:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979e00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789042997.422609:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c06314 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.422615:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c06314 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.422631:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa06a44e19c00) 00010000:00010000:2.0:1789042997.422634:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789042997.422638:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c06314 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.422643:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c06314 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.422653:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c0631b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.422656:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c0631b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.422659:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c0631b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.422663:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50978000 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789042997.422664:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c0631b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.422668:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c0631b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.422671:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa06a457d3700) 00010000:00010000:2.0:1789042997.422672:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789042997.422674:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c0631b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.422677:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c0631b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.422719:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c0630d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67697e expref: 18 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.422729:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06322 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67697e expref: 17 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.422734:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:2.0:1789042997.422735:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789042997.422737:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50978600, rc 0) 00000100:00100000:2.0:1789042997.422815:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+17:10384:x1875947242423168:12345-192.168.203.17@tcp:101:stat.0 Request processed in 970us (1955us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042997.422823:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 55 00000100:00100000:0.0:1789042997.461084:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042997.461132:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042997.461227:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242423296 00000100:00100000:3.0:1789042997.461242:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242423296 00000100:00100000:3.0:1789042997.461318:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 288 00000100:00100000:3.0:1789042997.461331:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2351:x1875947242423296:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1789042997.461432:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2351:x1875947242423296:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 105us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042997.461440:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 288 00000100:00100000:0.0:1789042997.461919:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042997.465945:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242423424 00000100:00100000:3.0:1789042997.465967:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242423424 00000100:00100000:3.0:1789042997.466093:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 76 00000100:00100000:3.0:1789042997.466106:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2351:x1875947242423424:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1789042997.466233:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2351:x1875947242423424:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 129us (4315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042997.466241:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 76 00000100:00080000:0.0:1789042997.466877:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789042997.468974:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242423552 00000100:00100000:1.0:1789042997.468995:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242423552 00000100:00100000:1.0:1789042997.469200:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 138 00000100:00100000:1.0:1789042997.469213:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2351:x1875947242423552:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1789042997.469337:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2351:x1875947242423552:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 125us (8203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042997.469345:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 138 00000100:00080000:0.0:1789042997.473731:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789042997.518960:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042997.519084:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242423808 00000100:00100000:3.0:1789042997.519098:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242423808 00000100:00100000:3.0:1789042997.519179:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 56 00000100:00100000:3.0:1789042997.519192:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+17:10394:x1875947242423808:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:3.0:1789042997.519223:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789042997.519256:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06329 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676985 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789042997.519398:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789042997.522171:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06329 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676985 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.522201:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a44e19000) 00010000:00010000:3.0:1789042997.522205:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789042997.522212:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06329 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676985 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.522234:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc28200, rc 0) 00000100:00100000:3.0:1789042997.522329:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+18:10394:x1875947242423808:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 3139us (3388us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1789042997.522338:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 56 00000100:00100000:0.0:1789042997.527316:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042997.528000:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242424064 00000100:00100000:3.0:1789042997.528017:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242424064 00000100:00100000:2.0:1789042997.528214:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 14 00000100:00100000:2.0:1789042997.528230:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+18:10394:x1875947242424064:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:2.0:1789042997.529110:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+19:10394:x1875947242424064:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 877us (1803us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1789042997.529124:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 14 00010000:00010000:3.0:1789042997.620084:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789042997.632452:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042997.632824:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242424320 00000100:00100000:2.0:1789042997.632838:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242424320 00000100:00100000:2.0:1789042997.632968:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 57 00000100:00100000:2.0:1789042997.632981:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5289f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+19:10400:x1875947242424320:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:2.0:1789042997.633046:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789042997.633073:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c06337 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca67698c expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.633229:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c0633e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.633249:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06322 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67697e expref: 20 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.633261:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c0633e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.633318:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06322 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67697e expref: 20 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.633344:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06322 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67697e expref: 20 pid: 6714 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042997.633362:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52dff800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875947267622400:192.168.203.17@tcp:104: 00000100:00100000:2.0:1789042997.633505:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a42ee4300 going to sleep for 11 seconds 00000100:00100000:2.0:1789042997.642895:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52dff800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875947267622400:192.168.203.17@tcp:104: 00010000:00010000:2.0:1789042997.642949:0:6714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c0633e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042997.643531:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042997.644307:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242424448 00000100:00100000:3.0:1789042997.644320:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242424448 00010000:00010000:3.0:1789042997.644386:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06322 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67697e expref: 21 pid: 6714 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042997.644655:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 40 00000100:00100000:3.0:1789042997.644667:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f835500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+21:2351:x1875947242424448:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789042997.644689:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789042997.644698:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06322 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67697e expref: 21 pid: 6714 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.644736:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06322 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67697e expref: 21 pid: 6714 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.644766:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06322 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67697e expref: 21 pid: 6714 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.644786:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:3.0:1789042997.644791:0:6705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c0633e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.644800:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c0633e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.644808:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c0633e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.644850:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789042997.644940:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f835500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+20:2351:x1875947242424448:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 274us (3139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042997.644949:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 40 00010000:00010000:2.0:1789042997.646251:0:6714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c0633e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.646271:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c0633e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789042997.646300:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1789042997.646740:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c06337 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67698c expref: 21 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.646772:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c0633e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67698c expref: 20 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.647077:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:2.0:1789042997.647081:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789042997.647085:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50979e00, rc 0) 00000100:00100000:2.0:1789042997.647181:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5289f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+20:10400:x1875947242424320:12345-192.168.203.17@tcp:101:bash.0 Request processed in 14200us (14744us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1789042997.647199:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 57 00000100:00100000:0.0:1789042997.657646:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042997.658075:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242424704 00000100:00100000:3.0:1789042997.658091:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242424704 00000100:00100000:3.0:1789042997.658174:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 58 00000100:00100000:3.0:1789042997.658186:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+20:10400:x1875947242424704:12345-192.168.203.17@tcp:36:bash.0 00010000:00010000:3.0:1789042997.659213:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c0634c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.659240:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c0634c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.660080:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c0634c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789042997.660204:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1789042997.660250:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d482734 reply state 00000000553c8bf4 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c0634c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042997.660261:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789042997.661023:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+23:10400:x1875947242424704:12345-192.168.203.17@tcp:36:bash.0 Request processed in 2828us (3380us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1789042997.661045:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 58 00000020:00080000:3.0:1789042997.661054:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789042997.666449:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c0634c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.666474:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c0634c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.666484:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c0634c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.666492:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc28200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789042997.666498:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c0634c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.666555:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c0634c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.666581:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:3.0:1789042997.666584:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789042997.666615:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c0634c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.666623:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c0634c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042997.671574:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042997.671999:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242424832 00000100:00100000:3.0:1789042997.672013:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242424832 00000100:00100000:3.0:1789042997.672096:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 59 00000100:00100000:3.0:1789042997.672107:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52463100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+22:10400:x1875947242424832:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:3.0:1789042997.672140:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789042997.672167:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06353 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676993 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.672280:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c0635a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.672299:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c0633e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67698c expref: 23 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.672310:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c0635a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.672357:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c0633e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67698c expref: 23 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.672374:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c0633e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67698c expref: 23 pid: 6714 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042997.672391:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a763c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875947267622528:192.168.203.17@tcp:104: 00000100:00100000:2.0:1789042997.673563:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a4733d540 going to sleep for 11 seconds 00000100:00100000:1.0:1789042997.690678:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042997.690929:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a763c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875947267622528:192.168.203.17@tcp:104: 00010000:00010000:2.0:1789042997.690969:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c0635a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042997.691133:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242424960 00000100:00100000:0.0:1789042997.691143:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242424960 00010000:00010000:0.0:1789042997.691192:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c0633e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67698c expref: 24 pid: 6714 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042997.691243:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 41 00000100:00100000:0.0:1789042997.691255:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5289fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+24:2352:x1875947242424960:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789042997.691286:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789042997.691295:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c0633e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67698c expref: 24 pid: 6714 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042997.691334:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c0633e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67698c expref: 24 pid: 6714 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042997.691371:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c0633e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67698c expref: 24 pid: 6714 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042997.691395:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:0.0:1789042997.691413:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c0635a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042997.691424:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c0635a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042997.691434:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c0635a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042997.691470:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789042997.691610:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5289fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+23:2352:x1875947242424960:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 357us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042997.691618:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 41 00010000:00010000:2.0:1789042997.691855:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c0635a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.691865:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c0635a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789042997.691958:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789042997.691964:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789042997.691999:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c0635a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.692052:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06353 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676993 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.692089:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c0635a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676993 expref: 22 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.692098:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:2.0:1789042997.692101:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789042997.692104:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc28800, rc 0) 00000100:00100000:2.0:1789042997.692135:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52463100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+22:10400:x1875947242424832:12345-192.168.203.17@tcp:101:bash.0 Request processed in 20030us (20580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042997.692143:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 59 00000100:00100000:0.0:1789042997.698100:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042997.698215:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242425216 00000100:00100000:1.0:1789042997.698229:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242425216 00000100:00100000:1.0:1789042997.698336:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 15 00000100:00100000:1.0:1789042997.698350:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a50c21c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+22:10400:x1875947242425216:12345-192.168.203.17@tcp:35:bash.0 00000100:00100000:1.0:1789042997.698745:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a50c21c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+23:10400:x1875947242425216:12345-192.168.203.17@tcp:35:bash.0 Request processed in 398us (662us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1789042997.698761:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 15 00000100:00100000:2.0:1789042997.805562:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042997.808242:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242425472 00000100:00100000:0.0:1789042997.808269:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242425472 00000100:00100000:0.0:1789042997.808381:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 60 00000100:00100000:0.0:1789042997.808394:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+23:10410:x1875947242425472:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:0.0:1789042997.808431:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789042997.808464:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c06361 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca67699a expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789042997.808730:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789042997.809728:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c06361 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67699a expref: 25 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042997.809750:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a44e19000) 00010000:00010000:0.0:1789042997.809753:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789042997.812147:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c06361 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67699a expref: 25 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042997.812183:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a413a0800, rc 0) 00000100:00100000:0.0:1789042997.812389:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+24:10410:x1875947242425472:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 3994us (6903us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1789042997.812401:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 60 00000100:00100000:0.0:1789042997.821878:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042997.822013:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242425600 00000100:00100000:3.0:1789042997.822028:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242425600 00000100:00100000:3.0:1789042997.822114:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 61 00000100:00100000:3.0:1789042997.822127:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+24:10410:x1875947242425600:12345-192.168.203.17@tcp:34:lfs.0 00010000:00010000:3.0:1789042997.822240:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c0636f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.822262:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c0636f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.822278:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c0636f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.822296:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06376 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.822304:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06376 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.822311:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06376 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.828637:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c0637d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.828667:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c0637d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.828685:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c0637d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789042997.828758:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c0637d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.828786:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c0636f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.828793:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c0636f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.828800:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c0636f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.828806:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc28200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789042997.828810:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c0636f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.828818:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c0636f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.828833:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa06a44e19c00) 00010000:00010000:3.0:1789042997.828836:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789042997.828842:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c0636f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.828849:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c0636f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.828866:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06376 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.828873:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06376 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.828879:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06376 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.828891:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc28400 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789042997.828894:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06376 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.828901:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06376 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.828909:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa06a55d80a00) 00010000:00010000:3.0:1789042997.828911:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789042997.828915:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06376 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.828921:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06376 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.828939:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c0637d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.828945:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c0637d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.828951:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c0637d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.828956:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc28a00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789042997.828959:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c0637d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.828965:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c0637d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.828985:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:3.0:1789042997.828987:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789042997.828990:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c0637d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.828996:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c0637d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042997.829124:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+24:10410:x1875947242425600:12345-192.168.203.17@tcp:34:lfs.0 Request processed in 6993us (7255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042997.829135:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 61 00000100:00100000:2.0:1789042997.833408:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042997.833547:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242425856 00000100:00100000:1.0:1789042997.833561:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242425856 00000100:00100000:1.0:1789042997.833642:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 16 00000100:00100000:1.0:1789042997.833655:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+24:10410:x1875947242425856:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:1.0:1789042997.834053:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+25:10410:x1875947242425856:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 400us (660us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1789042997.834061:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 16 00000100:00100000:2.0:1789042997.891685:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042997.891757:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242426112 00000100:00100000:1.0:1789042997.891791:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242426112 00000100:00100000:1.0:1789042997.891984:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 62 00000100:00100000:1.0:1789042997.891999:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52dfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+25:10413:x1875947242426112:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1789042997.892047:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789042997.892075:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06384 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca6769a1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.892180:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c0638b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.892197:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c0638b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.892211:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c0638b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.892227:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06392 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.892234:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06392 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.892240:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06392 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.892994:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06399 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.893010:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06399 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.893019:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06399 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789042997.893050:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789042997.893177:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c0638b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.893187:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c0638b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.893196:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c0638b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.893204:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687400 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789042997.893209:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c0638b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.893217:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c0638b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.893231:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa06a44e19c00) 00010000:00010000:1.0:1789042997.893234:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789042997.893240:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c0638b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.893247:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c0638b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.893261:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06392 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.893268:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06392 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.893288:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06392 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.893293:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789042997.893296:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06392 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.893302:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06392 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.893311:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa06a44e19500) 00010000:00010000:1.0:1789042997.893314:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789042997.893317:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06392 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.893323:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06392 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.893384:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06384 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769a1 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.893402:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06399 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769a1 expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042997.893409:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:1.0:1789042997.893411:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789042997.893414:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41686e00, rc 0) 00000100:00100000:2.0:1789042997.894238:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52dfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+27:10413:x1875947242426112:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 2237us (2564us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1789042997.894251:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 62 00000100:00100000:0.0:1789042997.900958:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042997.901113:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042997.901208:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242426368 00000100:00100000:3.0:1789042997.901222:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242426368 00000100:00100000:3.0:1789042997.901306:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 4 00000100:00100000:3.0:1789042997.901318:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+27:2351:x1875947242426368:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789042997.901339:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789042997.901371:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06399 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769a1 expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042997.901408:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:3.0:1789042997.901415:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789042997.901796:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+26:2351:x1875947242426368:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 183us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042997.901807:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 4 00000100:00100000:2.0:1789042997.903687:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242426240 00000100:00100000:2.0:1789042997.903706:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242426240 00000100:00100000:2.0:1789042997.903784:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 63 00000100:00100000:2.0:1789042997.903796:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+26:10413:x1875947242426240:12345-192.168.203.17@tcp:54:lfs.0 00010000:00010000:2.0:1789042997.903995:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c063a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.904016:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c063a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.904039:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c063a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.904095:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c063a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.904103:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c063a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.904110:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c063a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.904116:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50978600 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789042997.904121:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c063a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.904130:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c063a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.904142:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:2.0:1789042997.904145:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789042997.904151:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c063a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042997.904157:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c063a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042997.904318:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+26:10413:x1875947242426240:12345-192.168.203.17@tcp:54:lfs.0 Request processed in 523us (3377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042997.904326:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 63 00000100:00100000:0.0:1789042997.909189:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042997.909296:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242426624 00000100:00100000:1.0:1789042997.909311:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242426624 00000100:00100000:1.0:1789042997.909421:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 17 00000100:00100000:1.0:1789042997.909434:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+26:10413:x1875947242426624:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:1.0:1789042997.910267:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+27:10413:x1875947242426624:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 830us (1089us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1789042997.910332:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 17 00000100:00100000:0.0:1789042998.129804:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042998.129963:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242426880 00000100:00100000:1.0:1789042998.129976:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242426880 00000100:00100000:1.0:1789042998.130064:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 64 00000100:00100000:1.0:1789042998.130076:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+27:10431:x1875947242426880:12345-192.168.203.17@tcp:101:cat.0 00010000:00010000:1.0:1789042998.130107:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789042998.130133:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c063ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca6769a8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042998.130256:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c063b5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042998.130274:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c063b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042998.130289:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c063b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789042998.130301:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789042998.130474:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c063ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769a8 expref: 30 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042998.130496:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c063b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769a8 expref: 29 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042998.130590:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:1.0:1789042998.130594:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789042998.130600:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41687200, rc 0) 00000100:00100000:1.0:1789042998.130683:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+29:10431:x1875947242426880:12345-192.168.203.17@tcp:101:cat.0 Request processed in 609us (894us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1789042998.130691:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 64 00000100:00100000:3.0:1789042998.162206:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042998.162325:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242427008 00000100:00100000:0.0:1789042998.162340:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242427008 00000100:00100000:0.0:1789042998.162599:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 65 00000100:00100000:0.0:1789042998.162610:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+29:10432:x1875947242427008:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:0.0:1789042998.162642:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789042998.162667:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0200/0x99260d7389c063c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca6769af expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042998.162786:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c063ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042998.162804:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c063ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042998.162831:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c063ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789042998.162877:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789042998.162882:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789042998.162906:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c063ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042998.162937:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0200/0x99260d7389c063c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769af expref: 31 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042998.162970:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c063ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769af expref: 30 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042998.162981:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa06a44e19c00) 00010000:00010000:0.0:1789042998.162984:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789042998.162988:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a413a0600, rc 0) 00000100:00100000:0.0:1789042998.163256:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+30:10432:x1875947242427008:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 645us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042998.163264:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 65 00000100:00100000:0.0:1789042998.171609:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042998.171809:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242427392 00000100:00100000:3.0:1789042998.171834:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242427392 00000100:00100000:3.0:1789042998.171931:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 18 00000100:00100000:3.0:1789042998.171943:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+30:10432:x1875947242427392:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:3.0:1789042998.172387:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+31:10432:x1875947242427392:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 444us (791us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1789042998.172405:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 18 00000100:00100000:1.0:1789042998.183128:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042998.183262:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242427520 00000100:00100000:3.0:1789042998.183283:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242427520 00000100:00100000:3.0:1789042998.183361:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 5 00000100:00100000:3.0:1789042998.183372:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5289d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+31:10432:x1875947242427520:12345-192.168.203.17@tcp:103:lfs.0 00010000:00010000:3.0:1789042998.183402:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789042998.183432:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c0635a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676993 expref: 31 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042998.183459:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c063b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769a8 expref: 30 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042998.183473:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c0625e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676954 expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042998.183482:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:3.0:1789042998.183724:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789042998.183804:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5289d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+28:10432:x1875947242427520:12345-192.168.203.17@tcp:103:lfs.0 Request processed in 432us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042998.184109:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 5 00000100:00100000:2.0:1789042998.195871:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042998.196026:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242427648 00000100:00100000:1.0:1789042998.196051:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242427648 00000100:00100000:1.0:1789042998.196133:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 66 00000100:00100000:1.0:1789042998.196145:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+28:10432:x1875947242427648:12345-192.168.203.17@tcp:58:lfs.0 00010000:00010000:1.0:1789042998.196292:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c063d1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042998.196313:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c063d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042998.196328:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c063d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789042998.202554:0:6714:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789042998.202797:0:6714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1789042998.203685:0:6714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1789042998.204073:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+28:10432:x1875947242427648:12345-192.168.203.17@tcp:58:lfs.0 Request processed in 7922us (8208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042998.204089:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 66 00000100:00100000:0.0:1789042998.227262:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042998.227427:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242427776 00000100:00100000:3.0:1789042998.227443:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242427776 00000100:00100000:3.0:1789042998.227568:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 67 00000100:00100000:3.0:1789042998.227603:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+28:10434:x1875947242427776:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:3.0:1789042998.227634:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789042998.227665:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c063d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca6769b6 expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042998.227748:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c063df lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042998.227765:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c063df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042998.227779:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c063df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042998.227794:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c063e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042998.227801:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c063e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042998.227808:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c063e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042998.228126:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c063ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042998.228135:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c063ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042998.228143:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c063ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789042998.228204:0:11703:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789042998.228209:0:11703:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789042998.228231:0:11703:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c063ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042998.228244:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c063ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042998.228253:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c063df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042998.228260:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c063df lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042998.228266:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c063df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042998.228281:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc28a00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789042998.228286:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c063df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042998.228295:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c063df lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042998.228308:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa06a44e19c00) 00010000:00010000:3.0:1789042998.228311:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789042998.228317:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c063df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042998.228324:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c063df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042998.228349:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c063e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042998.228355:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c063e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042998.228360:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c063e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042998.228365:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc28400 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789042998.228368:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c063e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042998.228374:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c063e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042998.228380:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa06a55d80a00) 00010000:00010000:3.0:1789042998.228382:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789042998.228385:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c063e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042998.228391:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c063e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042998.228424:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c063d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769b6 expref: 30 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042998.228436:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c063ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769b6 expref: 29 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042998.228454:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a44e19500) 00010000:00010000:3.0:1789042998.228457:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789042998.228459:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc28200, rc 0) 00000100:00100000:3.0:1789042998.229366:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+29:10434:x1875947242427776:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 1758us (2112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042998.229378:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 67 00000100:00100000:1.0:1789042998.523081:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267622656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789042998.523206:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789042998.523425:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267622656 00000100:00100000:0.0:1789042998.523436:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267622656 00000100:00100000:3.0:1789042998.523554:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789042998.523566:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5289d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875947267622656:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789042998.523593:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1789042998.523660:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789042998.523756:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5289d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875947267622656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 193us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042998.523799:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267622656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789042998.526992:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00010000:3.0:1789042998.643819:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789042999.218715:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789042999.218724:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789042999.218792:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789042999.218800:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789042999.218939:0:11689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52dfc380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1875947267622784:192.168.203.17@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789042999.219041:0:11689:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a42ee4000 going to sleep for 11 seconds 00000100:00100000:0.0:1789042999.229262:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042999.229301:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242427904 00000100:00100000:0.0:1789042999.229310:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242427904 00000100:00100000:0.0:1789042999.229366:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 1 00000100:00100000:0.0:1789042999.229377:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3fb32839-ebfd-4c0f-90e4-f036c86704df+30:10445:x1875947242427904:12345-192.168.203.17@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789042999.229454:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3fb32839-ebfd-4c0f-90e4-f036c86704df+30:10445:x1875947242427904:12345-192.168.203.17@tcp:900:lhsmtool_posix.0 Request processed in 78us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042999.229462:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 1 00000100:00080000:0.0:1789042999.229486:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789042999.229947:0:11689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52dfc380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1875947267622784:192.168.203.17@tcp:107:hsm_cdtr.0 00000040:00080000:2.0:1789042999.245053:0:12004:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789042999.245062:0:12004:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789042999.245097:0:12004:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789042999.245103:0:12004:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789042999.254336:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042999.254381:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242428032 00000100:00100000:2.0:1789042999.254391:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242428032 00000100:00100000:2.0:1789042999.254444:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 68 00000100:00100000:2.0:1789042999.254454:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+29:10445:x1875947242428032:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789042999.254485:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789042999.254613:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+29:10445:x1875947242428032:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 Request processed in 160us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042999.254620:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 68 00000100:00100000:3.0:1789042999.262077:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042999.265204:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242428160 00000100:00100000:0.0:1789042999.265218:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242428160 00000100:00100000:0.0:1789042999.265287:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 69 00000100:00100000:0.0:1789042999.265298:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+29:10445:x1875947242428160:12345-192.168.203.17@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789042999.265369:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c063f4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.265386:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c063f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.265399:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c063f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.265469:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c063fb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.265478:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c063fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.265485:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c063fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.265534:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0200/0x99260d7389c06402 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.265544:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0200/0x99260d7389c06402 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.265552:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0200/0x99260d7389c06402 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789042999.265589:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789042999.265595:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789042999.265608:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0200/0x99260d7389c06402 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.265620:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c063f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.265628:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c063f4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.265635:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c063f4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.265652:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a413a0e00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789042999.265657:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c063f4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.265665:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c063f4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.265677:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa06a44e19600) 00010000:00010000:0.0:1789042999.265680:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789042999.265685:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c063f4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.265692:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c063f4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.265703:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c063fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.265710:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c063fb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.265716:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c063fb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.265722:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a413a0800 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789042999.265725:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c063fb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.265732:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c063fb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.265749:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffffa06a55221a00) 00010000:00010000:0.0:1789042999.265751:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789042999.265754:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c063fb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.265760:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c063fb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.265772:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0200/0x99260d7389c06402 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.265779:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0200/0x99260d7389c06402 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.265785:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0200/0x99260d7389c06402 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.265789:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a413a0200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789042999.265792:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0200/0x99260d7389c06402 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.265798:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0200/0x99260d7389c06402 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.265805:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a44e19500) 00010000:00010000:0.0:1789042999.265807:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789042999.265810:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0200/0x99260d7389c06402 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.265816:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0200/0x99260d7389c06402 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042999.266233:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+29:10445:x1875947242428160:12345-192.168.203.17@tcp:34:lhsmtool_posix.0 Request processed in 934us (4163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042999.266243:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 69 00000100:00100000:2.0:1789042999.278037:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042999.278187:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242428416 00000100:00100000:0.0:1789042999.278198:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242428416 00000100:00100000:0.0:1789042999.278963:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 70 00000100:00100000:0.0:1789042999.278977:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52dfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+29:10445:x1875947242428416:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789042999.279000:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789042999.279035:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06409 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca6769bd expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.279206:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06410 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.279223:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06410 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.279235:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06410 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789042999.279248:0:11703:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789042999.279344:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06410 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.279352:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06410 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.279359:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06410 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.279383:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a40031600 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789042999.279387:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06410 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.279395:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06410 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.279407:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a44e19500) 00010000:00010000:0.0:1789042999.279409:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789042999.279414:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06410 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.279421:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06410 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.279464:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06409 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769bd expref: 31 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.279474:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa06a44e19600) 00010000:00010000:0.0:1789042999.279476:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789042999.279480:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06409 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769bd expref: 31 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.279490:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a40031a00, rc 0) 00000100:00100000:0.0:1789042999.279570:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52dfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+30:10445:x1875947242428416:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 597us (1555us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1789042999.279581:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 70 00000100:00100000:2.0:1789042999.286586:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042999.286967:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242428544 00000100:00100000:3.0:1789042999.286986:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242428544 00000100:00100000:3.0:1789042999.287269:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 71 00000100:00100000:3.0:1789042999.287283:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52dfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+30:10445:x1875947242428544:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789042999.287353:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789042999.287546:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52dfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+30:10445:x1875947242428544:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 Request processed in 266us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042999.287554:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 71 00000100:00100000:0.0:1789042999.293432:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042999.293487:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242428800 00000100:00100000:0.0:1789042999.293496:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242428800 00000100:00100000:0.0:1789042999.293568:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 72 00000100:00100000:0.0:1789042999.293578:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5097d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+30:10445:x1875947242428800:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789042999.293610:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789042999.293614:0:6714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789042999.293641:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c063ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769af expref: 30 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.297389:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa06a44e19c00) 00010000:00010000:0.0:1789042999.297402:0:6714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789042999.297428:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c0641e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca6769c4 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789042999.300110:0:6714:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1789042999.302418:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06425 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.302440:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06425 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.302454:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06425 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.303945:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c0641e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769c4 expref: 32 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.303975:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06425 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769c4 expref: 31 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.304005:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa06a55221a00) 00010000:00010000:0.0:1789042999.304008:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789042999.304012:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a40031600, rc 0) 00000100:00100000:0.0:1789042999.304339:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5097d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+31:10445:x1875947242428800:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 10760us (10915us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1789042999.304349:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 72 00000100:00100000:1.0:1789042999.327180:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042999.327715:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242429056 00000100:00100000:0.0:1789042999.327732:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242429056 00000100:00100000:0.0:1789042999.327816:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 73 00000100:00100000:0.0:1789042999.327828:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5289ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+31:10445:x1875947242429056:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789042999.327903:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789042999.327940:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06425 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769c4 expref: 31 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.327960:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa06a55221a00) 00010000:00010000:0.0:1789042999.327974:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789042999.328007:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06433 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.329509:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06433 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.329556:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06433 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.329592:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c0643a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x5dde9b81 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.329619:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c0643a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5dde9b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.329627:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c0643a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5dde9b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.329930:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06433 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.329940:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06433 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.329948:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06433 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.329956:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a40031a00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789042999.329961:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06433 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.329970:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06433 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.329983:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa06a44e19c00) 00010000:00010000:0.0:1789042999.329987:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789042999.329994:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06433 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.338681:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06433 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.338739:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c0643a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5dde9b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.338771:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c0643a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5dde9b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.338781:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c0643a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5dde9b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.338788:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a40031c00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789042999.338794:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c0643a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5dde9b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.338802:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c0643a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5dde9b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.338825:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x5dde9b81 (ffffa06a55221700) 00010000:00010000:0.0:1789042999.338828:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789042999.338834:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c0643a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5dde9b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.338841:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c0643a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5dde9b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042999.338994:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5289ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+30:10445:x1875947242429056:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 Request processed in 11161us (11821us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789042999.339004:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 73 00000100:00100000:1.0:1789042999.342639:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042999.343643:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242429184 00000100:00100000:3.0:1789042999.343667:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242429184 00000100:00100000:3.0:1789042999.343752:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 74 00000100:00100000:3.0:1789042999.343890:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5289c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+30:10445:x1875947242429184:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789042999.343918:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789042999.343949:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06441 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca6769cb expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042999.344068:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06448 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042999.344086:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06448 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042999.344100:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06448 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042999.344223:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06441 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769cb expref: 32 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042999.344241:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06448 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769cb expref: 31 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042999.344250:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa06a55d80f00) 00010000:00010000:3.0:1789042999.344253:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789042999.344258:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc28400, rc 0) 00000100:00100000:3.0:1789042999.344336:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5289c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+31:10445:x1875947242429184:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 572us (1709us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042999.344344:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 74 00000100:00100000:0.0:1789042999.353209:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042999.353319:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242429440 00000100:00100000:1.0:1789042999.353334:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242429440 00000100:00100000:1.0:1789042999.353445:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 75 00000100:00100000:1.0:1789042999.353459:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5097ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+31:10445:x1875947242429440:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789042999.353702:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c0644f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042999.353725:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c0644f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042999.353740:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c0644f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789042999.355884:0:6714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1789042999.355914:0:6714:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 342312397926ns, next at 343312394021ns, rc = 0 00000004:00010000:1.0:1789042999.356143:0:6714:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f1749fce reply state 00000000077e4361 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c0644f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042999.356170:0:6714:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789042999.357132:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5097ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+33:10445:x1875947242429440:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 Request processed in 3667us (3924us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1789042999.357215:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 75 00010000:00010000:2.0:1789042999.362068:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c0644f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.362091:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c0644f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.362100:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c0644f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.362107:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789042999.362121:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c0644f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.362131:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c0644f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.362152:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa06a55d80f00) 00010000:00010000:2.0:1789042999.362156:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789042999.362162:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c0644f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.362170:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c0644f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042999.367082:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042999.367714:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242429568 00000100:00100000:1.0:1789042999.367730:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242429568 00000100:00100000:1.0:1789042999.367869:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 76 00000100:00100000:1.0:1789042999.367882:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52dff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+32:10445:x1875947242429568:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789042999.367917:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789042999.367945:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06456 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca6769d2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042999.368054:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06456 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769d2 expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042999.368072:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06456 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769d2 expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042999.368095:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa06a55d80f00) 00010000:00010000:1.0:1789042999.368099:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789042999.368104:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41687200, rc 0) 00000100:00100000:1.0:1789042999.368915:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52dff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+33:10445:x1875947242429568:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 1030us (1842us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042999.368927:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 76 00000100:00100000:1.0:1789042999.373094:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042999.373943:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242429696 00000100:00100000:2.0:1789042999.373958:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242429696 00000100:00100000:2.0:1789042999.374044:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 25 00000100:00100000:2.0:1789042999.374054:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5289e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1875947242429696:12345-192.168.203.17@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1789042999.374097:0:6691:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3fb32839-ebfd-4c0f-90e4-f036c86704df@192.168.203.17@tcp t0 exp 0000000000000000 cur 342 last 0 00000020:00000080:2.0:1789042999.374139:0:6691:0:(genops.c:1393:class_connect()) connect: client 3fb32839-ebfd-4c0f-90e4-f036c86704df, cookie 0x99260d7389c0645d 00002000:00100000:2.0:1789042999.374155:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3fb32839-ebfd-4c0f-90e4-f036c86704df/ffffa06a7f847800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789042999.374185:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789042999.374479:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789042999.374545:0:6691:0:(import.c:65:import_set_state_nolock()) ffffa06a7f844000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789042999.374646:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5289e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2348:x1875947242429696:12345-192.168.203.17@tcp:8:lhsmtool_posix.0 Request processed in 592us (1570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042999.374655:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 25 00000100:00100000:1.0:1789042999.381685:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042999.381768:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242429824 00000100:00100000:3.0:1789042999.381790:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242429824 00000100:00100000:3.0:1789042999.381880:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 26 00000100:00100000:3.0:1789042999.381894:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5289dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:0:x1875947242429824:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1789042999.382248:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1789042999.495120:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3fb32839-ebfd-4c0f-90e4-f036c86704df 00000001:00080000:1.0:1789042999.495157:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:2.0:1789042999.497846:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5289dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:0:x1875947242429824:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 Request processed in 115939us (116168us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789042999.497862:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 26 00000100:00100000:0.0:1789042999.510090:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042999.510898:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242430080 00000100:00100000:1.0:1789042999.510913:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242430080 00000100:00100000:1.0:1789042999.510994:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 19 00000100:00100000:1.0:1789042999.511006:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5097ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+33:10445:x1875947242430080:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789042999.511343:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5097ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+34:10445:x1875947242430080:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 Request processed in 338us (1265us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1789042999.511352:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 19 00000100:00100000:1.0:1789042999.519077:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042999.520091:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242430336 00000100:00100000:3.0:1789042999.520107:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242430336 00000100:00100000:3.0:1789042999.520178:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 77 00000100:00100000:3.0:1789042999.520192:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5289d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+34:10445:x1875947242430336:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789042999.520340:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5289d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+34:10445:x1875947242430336:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 Request processed in 151us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042999.520349:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 77 00000100:00100000:3.0:1789042999.523169:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042999.523217:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242430464 00000100:00100000:3.0:1789042999.523230:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242430464 00000100:00100000:3.0:1789042999.523300:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 78 00000100:00100000:3.0:1789042999.523313:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+34:10445:x1875947242430464:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789042999.523337:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789042999.523364:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06464 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca6769d9 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042999.523453:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c0646b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042999.523470:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c0646b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042999.523483:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c0646b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789042999.523574:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789042999.523599:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c0646b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042999.523629:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06464 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769d9 expref: 36 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042999.523650:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c0646b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769d9 expref: 35 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042999.523659:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa06a55d80f00) 00010000:00010000:3.0:1789042999.523663:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789042999.523668:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc28800, rc 0) 00000100:00100000:3.0:1789042999.523737:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+35:10445:x1875947242430464:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 426us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042999.523745:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 78 00000100:00100000:0.0:1789042999.534958:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042999.539076:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242430592 00000100:00100000:3.0:1789042999.539099:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242430592 00000100:00100000:3.0:1789042999.541530:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 27 00000100:00100000:3.0:1789042999.541555:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5097f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2351:x1875947242430592:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789042999.541580:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789042999.541610:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083f7dbf9/0x99260d7389c06472 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca6769e0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789042999.541646:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa2a137, blocks: 0x1 00010000:00010000:3.0:1789042999.541672:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=342s v=(0 0) 00010000:00010000:3.0:1789042999.541692:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789042999.541705:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083f7dbf9/0x99260d7389c06472 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769e0 expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042999.541733:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000083f7dbf9/0x99260d7389c06472 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769e0 expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042999.541751:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc28a00, rc 0) 00000100:00100000:3.0:1789042999.541855:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5097f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2351:x1875947242430592:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 308us (6910us total) trans 0 rc 0/0 00000100:00100000:3.0:1789042999.541864:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 27 00000100:00100000:3.0:1789042999.561942:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042999.562008:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242430848 00000100:00100000:1.0:1789042999.562047:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242430848 00000100:00100000:1.0:1789042999.562128:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 79 00000100:00100000:1.0:1789042999.562142:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+35:10445:x1875947242430848:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789042999.562292:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+35:10445:x1875947242430848:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 Request processed in 154us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042999.562301:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 79 00000100:00100000:0.0:1789042999.566742:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042999.566878:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242430976 00000100:00100000:1.0:1789042999.566893:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242430976 00000100:00100000:1.0:1789042999.566975:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 28 00000100:00100000:1.0:1789042999.566989:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5097e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:10445:x1875947242430976:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789042999.567014:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789042999.567054:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001d56710/0x99260d7389c06479 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca6769e7 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042999.567098:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000083f7dbf9/0x99260d7389c06472 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769e0 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042999.567109:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789042999.567114:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789042999.567120:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001d56710/0x99260d7389c06479 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769e7 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042999.567166:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000083f7dbf9/0x99260d7389c06472 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769e0 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042999.567181:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000083f7dbf9/0x99260d7389c06472 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769e0 expref: 7 pid: 6691 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042999.567207:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a5289c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6690:1875947267622912:192.168.203.17@tcp:104: 00000100:00100000:1.0:1789042999.567332:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a454a6000 going to sleep for 11 seconds 00000100:00100000:1.0:1789042999.574722:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a5289c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6690:1875947267622912:192.168.203.17@tcp:104: 00000100:00100000:0.0:1789042999.574725:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042999.574820:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242431104 00000100:00100000:3.0:1789042999.574829:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242431104 00010000:00010000:1.0:1789042999.574854:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000001d56710/0x99260d7389c06479 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769e7 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042999.574872:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000083f7dbf9/0x99260d7389c06472 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769e0 expref: 8 pid: 6691 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042999.574878:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41686600, rc 0) 00000100:00100000:3.0:1789042999.574915:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 42 00000100:00100000:3.0:1789042999.574925:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:2352:x1875947242431104:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789042999.574941:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789042999.574970:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000083f7dbf9/0x99260d7389c06472 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769e0 expref: 8 pid: 6691 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042999.574983:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000083f7dbf9/0x99260d7389c06472 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769e0 expref: 8 pid: 6691 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042999.575042:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5097e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:10445:x1875947242430976:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 8056us (8315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042999.575051:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 28 00010000:00010000:3.0:1789042999.575089:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083f7dbf9/0x99260d7389c06472 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769e0 expref: 7 pid: 6691 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042999.575108:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789042999.575113:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789042999.575122:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000001d56710/0x99260d7389c06479 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769e7 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042999.575133:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001d56710/0x99260d7389c06479 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769e7 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042999.575188:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000001d56710/0x99260d7389c06479 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769e7 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042999.575205:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a763c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5831:1875947267623040:192.168.203.17@tcp:105: 00000100:00100000:3.0:1789042999.575260:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a412ed300 going to sleep for 11 seconds 00000100:00100000:1.0:1789042999.585122:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a763c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5831:1875947267623040:192.168.203.17@tcp:105: 00010000:00010000:1.0:1789042999.585160:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789042999.585237:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2352:x1875947242431104:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 10311us (10512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042999.585249:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 42 00000100:00100000:3.0:1789042999.589058:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042999.589290:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242431232 00000100:00100000:0.0:1789042999.589305:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242431232 00002000:00100000:0.0:1789042999.589365:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffffa06a763c8e00 x1875947242431232/t0(0) o4->3fb32839-ebfd-4c0f-90e4-f036c86704df@192.168.203.17@tcp:295/0 lens 504/0 e 0 to 0 dl 1789043010 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789042999.589377:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa06a763c8e00 with x1875947242431232 ext(0->8) 00002000:00010000:0.0:1789042999.589383:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa06a763c8e00 00000100:00100000:0.0:1789042999.589473:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 0 00000100:00100000:0.0:1789042999.589484:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2349:x1875947242431232:12345-192.168.203.17@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789042999.590897:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:2349:x1875947242431232:12345-192.168.203.17@tcp:4:lhsmtool_posix.0 Request processed in 1407us (1846us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789042999.590910:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 0 00002000:00100000:1.0:1789042999.590921:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffffa06a763c8e00 x1875947242431232/t4294967302(0) o4->3fb32839-ebfd-4c0f-90e4-f036c86704df@192.168.203.17@tcp:295/0 lens 504/448 e 0 to 0 dl 1789043010 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789042999.590931:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa06a763c8e00 with x1875947242431232 ext(0->8) 00002000:00010000:1.0:1789042999.590937:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa06a763c8e00 00000100:00100000:0.0:1789042999.595836:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789042999.595947:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242431360 00000100:00100000:3.0:1789042999.595961:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242431360 00000100:00100000:3.0:1789042999.596052:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 80 00000100:00100000:3.0:1789042999.596064:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5097df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+35:10445:x1875947242431360:12345-192.168.203.17@tcp:44:lhsmtool_posix.0 00010000:00010000:3.0:1789042999.671289:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789042999.674069:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000020:00080000:3.0:1789042999.674101:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:3.0:1789042999.674138:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1789042999.674295:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:3.0:1789042999.674371:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1789042999.674385:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1789042999.674800:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789042999.674829:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a5097d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267623168:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789042999.674941:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042999.674979:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5097df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+13:10445:x1875947242431360:12345-192.168.203.17@tcp:44:lhsmtool_posix.0 Request processed in 78904us (79146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042999.674990:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 80 00000100:00100000:1.0:1789042999.675131:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267623168 00000100:00100000:1.0:1789042999.675140:0:8215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267623168 00000100:00100000:1.0:1789042999.675219:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789042999.675231:0:8215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267623168:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789042999.675461:0:8215:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789042999.675465:0:8215:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789042999 00002000:00010000:1.0:1789042999.675468:0:8215:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789042999.675470:0:8215:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789042999 -> 1789042999 00002000:00010000:1.0:1789042999.675472:0:8215:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789042999.675559:0:8215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1875947267623168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 332us (617us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789042999.675575:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:1.0:1789042999.675638:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa06a5097d880/2, rc 0, transno 4294967303 00000100:00100000:1.0:1789042999.675645:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a5097d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267623168:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1789042999.675969:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789042999.679293:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042999.679600:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242431488 00000100:00100000:2.0:1789042999.679622:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242431488 00000100:00100000:2.0:1789042999.679698:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 30 00000100:00100000:2.0:1789042999.679710:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:2352:x1875947242431488:12345-192.168.203.17@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789042999.745182:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:2352:x1875947242431488:12345-192.168.203.17@tcp:16:lhsmtool_posix.0 Request processed in 65458us (65886us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042999.745200:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 30 00000001:00080000:1.0:1789042999.745650:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:1.0:1789042999.745665:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1789042999.749422:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042999.750112:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242431744 00000100:00100000:2.0:1789042999.750127:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242431744 00000100:00100000:2.0:1789042999.750209:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 81 00000100:00100000:2.0:1789042999.750221:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+13:10445:x1875947242431744:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789042999.750295:0:11703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789042999.750333:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c0646b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769d9 expref: 13 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.750358:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa06a55d80f00) 00010000:00010000:2.0:1789042999.750365:0:11703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789042999.750405:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06480 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.750421:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06480 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.750433:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06480 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789042999.751279:0:11703:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd65ed30 reply state 00000000b8c82f6a transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06480 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042999.751293:0:11703:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789042999.751501:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+14:10445:x1875947242431744:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 Request processed in 1216us (2028us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1789042999.751510:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 81 00010000:00010000:3.0:1789042999.756679:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06480 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042999.756711:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06480 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042999.756720:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06480 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042999.756727:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50978e00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789042999.756734:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06480 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042999.756744:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06480 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042999.756764:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa06a55d80f00) 00010000:00010000:3.0:1789042999.756768:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789042999.756774:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06480 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042999.756781:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06480 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789042999.759251:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042999.759384:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242431872 00000100:00100000:1.0:1789042999.759398:0:8215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242431872 00000100:00100000:1.0:1789042999.759543:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 31 00000100:00100000:1.0:1789042999.759567:0:8215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2351:x1875947242431872:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789042999.760112:0:8215:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1789042999.760117:0:8215:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789042999 -> 1789042997 00002000:00010000:1.0:1789042999.760120:0:8215:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789042995 00002000:00010000:1.0:1789042999.760122:0:8215:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789042999 -> 1789042997 00002000:00010000:1.0:1789042999.760125:0:8215:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789042999.760251:0:8215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2351:x1875947242431872:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 Request processed in 696us (1764us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789042999.760284:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 31 00000100:00100000:0.0:1789042999.765752:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042999.765844:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242432128 00000100:00100000:1.0:1789042999.765858:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242432128 00000100:00100000:1.0:1789042999.765947:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 82 00000100:00100000:1.0:1789042999.765960:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+13:10445:x1875947242432128:12345-192.168.203.17@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789042999.766064:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06487 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042999.766086:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06448 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769cb expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042999.766098:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06487 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042999.766143:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06448 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769cb expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042999.766159:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06448 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769cb expref: 13 pid: 5847 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042999.766176:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a5289e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875947267623296:192.168.203.17@tcp:104: 00000100:00100000:1.0:1789042999.766294:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a412ed300 going to sleep for 11 seconds 00000100:00100000:3.0:1789042999.769734:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042999.770029:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242432256 00000100:00100000:2.0:1789042999.770041:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242432256 00010000:00010000:2.0:1789042999.770093:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06448 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769cb expref: 14 pid: 5847 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042999.770144:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 43 00000100:00100000:2.0:1789042999.770165:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+14:2352:x1875947242432256:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789042999.770183:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789042999.770190:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06448 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769cb expref: 14 pid: 5847 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.770206:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06448 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769cb expref: 14 pid: 5847 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.770234:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa06a55d80f00) 00010000:00010000:2.0:1789042999.770241:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06487 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.770253:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06487 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.770275:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06487 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.770302:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789042999.770376:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+14:2352:x1875947242432256:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 213us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042999.770385:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 43 00010000:00010000:1.0:1789042999.772783:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06448 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769cb expref: 13 pid: 5847 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042999.772816:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a5289e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875947267623296:192.168.203.17@tcp:104: 00010000:00010000:1.0:1789042999.772879:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06487 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.773374:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06487 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.773384:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06487 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.773500:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06487 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.773509:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06487 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.773996:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06487 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.774004:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687000 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789042999.774009:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06487 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.774030:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06487 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.774049:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa06a55d80f00) 00010000:00010000:0.0:1789042999.774052:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789042999.774059:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06487 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.774067:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06487 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042999.774288:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+12:10445:x1875947242432128:12345-192.168.203.17@tcp:55:lhsmtool_posix.0 Request processed in 8326us (8546us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789042999.774301:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 82 00000100:00100000:3.0:1789042999.776982:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042999.777364:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242432384 00000100:00100000:1.0:1789042999.777381:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242432384 00000100:00100000:1.0:1789042999.777684:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 32 00000100:00100000:1.0:1789042999.777700:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2352:x1875947242432384:12345-192.168.203.17@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789042999.777769:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c0648e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042999.777802:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000001d56710/0x99260d7389c06479 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769e7 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042999.777812:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789042999.777817:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789042999.777823:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c0648e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042999.777869:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000001d56710/0x99260d7389c06479 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769e7 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042999.777887:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000001d56710/0x99260d7389c06479 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769e7 expref: 7 pid: 6690 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042999.777904:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a5289e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6690:1875947267623424:192.168.203.17@tcp:104: 00000100:00100000:1.0:1789042999.778090:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a412ed300 going to sleep for 11 seconds 00000100:00100000:3.0:1789042999.781818:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042999.781993:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242432512 00000100:00100000:2.0:1789042999.782007:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242432512 00010000:00010000:2.0:1789042999.782068:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000001d56710/0x99260d7389c06479 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769e7 expref: 8 pid: 6690 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042999.782121:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 44 00000100:00100000:2.0:1789042999.782135:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:2352:x1875947242432512:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789042999.782193:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789042999.782224:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000001d56710/0x99260d7389c06479 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769e7 expref: 8 pid: 6690 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.782243:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000001d56710/0x99260d7389c06479 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769e7 expref: 8 pid: 6690 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.782278:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789042999.782283:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789042999.782291:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c0648e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.782316:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c0648e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.782343:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789042999.782408:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:2352:x1875947242432512:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 275us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042999.782416:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 44 00010000:00010000:1.0:1789042999.783388:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001d56710/0x99260d7389c06479 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769e7 expref: 7 pid: 6690 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042999.783415:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a5289e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6690:1875947267623424:192.168.203.17@tcp:104: 00010000:00010000:1.0:1789042999.783782:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c0648e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.783886:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c0648e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.783896:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c0648e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.783998:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c0648e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.784010:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c0648e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.784030:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c0648e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.784040:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687e00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:2.0:1789042999.784045:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c0648e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.784080:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c0648e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.784101:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c0648e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.784110:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c0648e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042999.784264:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2352:x1875947242432384:12345-192.168.203.17@tcp:1:lhsmtool_posix.0 Request processed in 6566us (7292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789042999.784275:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 32 00000100:00100000:3.0:1789042999.787423:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042999.787579:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242432768 00000100:00100000:2.0:1789042999.787594:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242432768 00000100:00100000:2.0:1789042999.787670:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 83 00000100:00100000:2.0:1789042999.787682:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+12:10445:x1875947242432768:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789042999.787790:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c06495 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.787814:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c06495 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.787829:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c06495 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.788115:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c0649c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.788143:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06456 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769d2 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.788154:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c0649c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.788199:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06456 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769d2 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.788216:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06456 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769d2 expref: 13 pid: 5846 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042999.788234:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52dffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875947267623552:192.168.203.17@tcp:104: 00000100:00100000:2.0:1789042999.788338:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a42ee40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789042999.793135:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789042999.793258:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52dffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875947267623552:192.168.203.17@tcp:104: 00010000:00010000:2.0:1789042999.793295:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c0649c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042999.793422:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242432896 00000100:00100000:1.0:1789042999.793431:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242432896 00010000:00010000:1.0:1789042999.793482:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06456 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769d2 expref: 14 pid: 5846 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789042999.793573:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 45 00000100:00100000:1.0:1789042999.793585:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+14:2352:x1875947242432896:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789042999.793604:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789042999.793611:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06456 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769d2 expref: 14 pid: 5846 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042999.793624:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06456 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769d2 expref: 14 pid: 5846 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042999.793650:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06456 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769d2 expref: 14 pid: 5846 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042999.793669:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa06a55d80f00) 00010000:00010000:1.0:1789042999.793675:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c0649c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042999.793706:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c0649c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042999.793715:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c0649c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789042999.793750:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789042999.793815:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+13:2352:x1875947242432896:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 233us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789042999.793824:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 45 00010000:00010000:3.0:1789042999.794060:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c0649c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042999.794068:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c0649c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789042999.794329:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1789042999.794507:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1789042999.795600:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1789042999.795721:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52dffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5845:1875947267623680:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789042999.795802:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042999.795834:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a42ee4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789042999.795983:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267623680 00000100:00100000:0.0:1789042999.795994:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267623680 00000100:00100000:0.0:1789042999.796062:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789042999.796073:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52dfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1875947267623680:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789042999.796171:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52dfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1875947267623680:12345-0@lo:1000:mdt00_000.0 Request processed in 100us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042999.796180:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789042999.796725:0:5845:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1789042999.796734:0:5845:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa06a5097d880, transno 4294967303 00000100:00100000:2.0:1789042999.796757:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52dffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5845:1875947267623680:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1789042999.797355:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1789042999.797457:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52dffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5845:1875947267623808:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789042999.798152:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789042999.798191:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a42ee4480 going to sleep for 11 seconds 00000100:00100000:0.0:1789042999.798210:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267623808 00000100:00100000:0.0:1789042999.798219:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267623808 00000100:00100000:0.0:1789042999.798272:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789042999.798281:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52dfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1875947267623808:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789042999.798727:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52dfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5845:x1875947267623808:12345-0@lo:1000:mdt00_000.0 Request processed in 445us (576us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789042999.798736:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789042999.798796:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52dffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5845:1875947267623808:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789042999.798843:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c0649c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.798855:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c0649c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.798864:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c0649c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.798872:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50978e00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789042999.798877:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c0649c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.798886:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c0649c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.798906:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa06a55d80f00) 00010000:00010000:2.0:1789042999.798909:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789042999.798915:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c0649c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.798986:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c0649c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.799044:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c063d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.799052:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c063d1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.799067:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c063d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.799073:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687400 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789042999.799076:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c063d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.799083:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c063d1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.799093:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a44e19500) 00010000:00010000:2.0:1789042999.799095:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789042999.799099:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c063d1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.799104:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c063d1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.799160:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c064a3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.799179:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c063ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769b6 expref: 16 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.799190:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c064a3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.799226:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c063ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769b6 expref: 16 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.799254:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c063ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769b6 expref: 16 pid: 11703 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042999.799268:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52dfc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875947267623936:192.168.203.17@tcp:104: 00000100:00100000:2.0:1789042999.799364:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a42ee4600 going to sleep for 11 seconds 00000100:00100000:3.0:1789042999.802824:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789042999.803191:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242433024 00000100:00100000:0.0:1789042999.803204:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242433024 00010000:00010000:0.0:1789042999.803263:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c063ed lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769b6 expref: 17 pid: 11703 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789042999.803310:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 46 00000100:00100000:0.0:1789042999.803322:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a453a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+17:2352:x1875947242433024:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789042999.803339:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789042999.803348:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c063ed lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769b6 expref: 17 pid: 11703 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.803364:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c063ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769b6 expref: 17 pid: 11703 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.803392:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a44e19500) 00010000:00010000:0.0:1789042999.803397:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c064a3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.803408:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c064a3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.803416:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c064a3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.803466:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789042999.803555:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a453a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+17:2352:x1875947242433024:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 234us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1789042999.803564:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 46 00010000:00010000:2.0:1789042999.808860:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c063ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769b6 expref: 16 pid: 11703 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042999.808898:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52dfc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875947267623936:192.168.203.17@tcp:104: 00010000:00010000:2.0:1789042999.809083:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c064a3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.809094:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c064a3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.809100:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c064a3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.809116:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c064a3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.809123:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c064a3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.809131:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c064a3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.809138:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789042999.809165:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c064a3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.809175:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c064a3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.809194:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a44e19500) 00010000:00010000:2.0:1789042999.809198:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789042999.809204:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c064a3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.809211:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c064a3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.809224:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c06495 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.809231:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c06495 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.809237:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c06495 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.809243:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50978a00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789042999.809245:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c06495 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.809252:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c06495 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.809260:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a44e19500) 00010000:00010000:2.0:1789042999.809263:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789042999.809272:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c06495 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789042999.809278:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c06495 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789042999.810148:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+15:10445:x1875947242432768:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 Request processed in 22455us (22727us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1789042999.810164:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 83 00000020:00080000:2.0:1789042999.810173:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789042999.810190:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789042999.810196:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789042999.810225:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789042999.810232:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789042999.815702:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789042999.815801:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242433280 00000100:00100000:1.0:1789042999.815816:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242433280 00000100:00100000:1.0:1789042999.815901:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 20 00000100:00100000:1.0:1789042999.815915:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942104e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+15:10445:x1875947242433280:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789042999.825106:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789042999.825241:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1789042999.825328:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c064aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.825350:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c064aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.825367:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c064aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.825378:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c064aa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.825386:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c064aa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.825393:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c064aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789042999.826277:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789042999.826790:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942104e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+17:10445:x1875947242433280:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 Request processed in 10870us (11095us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1789042999.826804:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 20 00000020:00080000:0.0:1789042999.826813:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789042999.828810:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789042999.828828:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c064aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042999.828841:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a40031a00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:3.0:1789042999.828846:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c064aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042999.828858:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c064aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042999.828880:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa06a55221a00) 00010000:00010000:3.0:1789042999.828884:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789042999.828913:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c064aa lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042999.828921:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c064aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789042999.828954:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789042999.828956:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789042999.828957:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043000.692493:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789043001.196822:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:3.0:1789043001.196840:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000040:00080000:1.0:1789043001.269304:0:12057:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789043001.269315:0:12057:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789043001.269379:0:12057:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789043001.269386:0:12057:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789043001.445305:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043001.445365:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242433536 00000100:00100000:2.0:1789043001.445380:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242433536 00000100:00100000:2.0:1789043001.445475:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 84 00000100:00100000:2.0:1789043001.445487:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+17:10463:x1875947242433536:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:2.0:1789043001.445562:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043001.445590:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c064b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca6769ee expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.445721:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979000/0x99260d7389c064b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.445739:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979000/0x99260d7389c064b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.445757:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979000/0x99260d7389c064b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789043001.445771:0:11703:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789043001.446190:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c064b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769ee expref: 20 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.446230:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979000/0x99260d7389c064b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769ee expref: 19 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.446240:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa06a44e19c00) 00010000:00010000:2.0:1789043001.446243:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789043001.446248:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50979000, rc 0) 00000100:00100000:2.0:1789043001.446339:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+19:10463:x1875947242433536:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 854us (1049us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1789043001.446349:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 84 00000100:00080000:0.0:1789043001.447034:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789043001.453634:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043001.453784:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242433664 00000100:00100000:1.0:1789043001.453796:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242433664 00000100:00100000:1.0:1789043001.453870:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 85 00000100:00100000:1.0:1789043001.453891:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52dfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+19:10463:x1875947242433664:12345-192.168.203.17@tcp:34:lfs.0 00010000:00010000:1.0:1789043001.454016:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c064c6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.454042:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c064c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.454091:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c064c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.454114:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c064cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.454123:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c064cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.454130:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c064cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.454659:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c064d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.454671:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c064d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.454680:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c064d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789043001.454739:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c064d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.454756:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c064c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.454764:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c064c6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.454772:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c064c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.454791:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686e00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043001.454796:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c064c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.454804:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c064c6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.454819:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa06a44e19c00) 00010000:00010000:1.0:1789043001.454823:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043001.454829:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c064c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.454836:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c064c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.454853:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c064cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.454860:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c064cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.454866:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c064cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.454872:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043001.454875:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c064cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.454881:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c064cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.454899:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa06a44e19800) 00010000:00010000:1.0:1789043001.454901:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043001.454904:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c064cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.455039:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c064cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.455064:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c064d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.455070:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c064d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.455143:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c064d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.455148:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686600 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043001.455151:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c064d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.455158:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c064d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.455167:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a44e19300) 00010000:00010000:1.0:1789043001.455170:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043001.455173:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c064d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.455179:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c064d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043001.455303:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52dfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+19:10463:x1875947242433664:12345-192.168.203.17@tcp:34:lfs.0 Request processed in 1417us (1674us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043001.455314:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 85 00000100:00100000:2.0:1789043001.519462:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043001.519783:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242433920 00000100:00100000:3.0:1789043001.519797:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242433920 00000100:00100000:3.0:1789043001.519871:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 86 00000100:00100000:3.0:1789043001.519891:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52dfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+19:10466:x1875947242433920:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:3.0:1789043001.520035:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789043001.520064:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c064db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca6769f5 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.520476:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c064e2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.520498:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c064e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.520800:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c064e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.520823:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29c00/0x99260d7389c064e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.520832:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29c00/0x99260d7389c064e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.520847:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29c00/0x99260d7389c064e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.521718:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c064f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.521732:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c064f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.521741:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c064f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789043001.521754:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789043001.521863:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c064e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.521872:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c064e2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.522754:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c064e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.522767:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc28a00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789043001.522772:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c064e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.522784:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c064e2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.522801:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa06a44e19c00) 00010000:00010000:3.0:1789043001.522805:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789043001.522828:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c064e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.522835:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c064e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.522857:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29c00/0x99260d7389c064e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.522865:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29c00/0x99260d7389c064e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.522871:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29c00/0x99260d7389c064e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.522887:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc29c00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789043001.522890:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29c00/0x99260d7389c064e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.522897:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29c00/0x99260d7389c064e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.522905:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa06a55d80a00) 00010000:00010000:3.0:1789043001.522907:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789043001.522911:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29c00/0x99260d7389c064e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.522923:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29c00/0x99260d7389c064e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.522994:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c064db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769f5 expref: 22 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.523031:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c064f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769f5 expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.523039:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a55d80d00) 00010000:00010000:3.0:1789043001.523042:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789043001.523044:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc29000, rc 0) 00000100:00100000:3.0:1789043001.523148:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52dfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+21:10466:x1875947242433920:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 3261us (3696us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1789043001.523158:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 86 00000100:00100000:0.0:1789043001.531708:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043001.534174:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242434048 00000100:00100000:1.0:1789043001.534189:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242434048 00000100:00100000:1.0:1789043001.534256:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 87 00000100:00100000:1.0:1789043001.534267:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+21:10466:x1875947242434048:12345-192.168.203.17@tcp:54:lfs.0 00010000:00010000:1.0:1789043001.534621:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c064fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.534650:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c064fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.534663:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c064fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.534692:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c064fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.534700:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c064fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.534707:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c064fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.534714:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686600 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043001.534719:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c064fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.534727:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c064fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.534756:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a55d80d00) 00010000:00010000:1.0:1789043001.534759:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789043001.534765:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c064fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.534772:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c064fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043001.534856:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+21:10466:x1875947242434048:12345-192.168.203.17@tcp:54:lfs.0 Request processed in 590us (3156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043001.534865:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 87 00000100:00100000:3.0:1789043001.539484:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043001.539719:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242434304 00000100:00100000:1.0:1789043001.539734:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242434304 00000100:00100000:1.0:1789043001.539814:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 21 00000100:00100000:1.0:1789043001.539825:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a50c21050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+21:10466:x1875947242434304:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:1.0:1789043001.540085:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a50c21050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+22:10466:x1875947242434304:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 262us (618us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1789043001.540094:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 21 00000100:00100000:1.0:1789043001.589599:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06942104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3314:1875947267624064:0@lo:400:kworker.0 00000100:00100000:1.0:1789043001.589688:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043001.589748:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6fc26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875947267624576:0@lo:400:kworker.0 00000100:00100000:3.0:1789043001.590183:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043001.590241:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6fc25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875947267624320:0@lo:400:kworker.0 00000100:00100000:3.0:1789043001.590277:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043001.590314:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789043001.590320:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6fc25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267624448:0@lo:400:kworker.0 00000100:00100000:1.0:1789043001.590500:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242434560 00000100:00100000:1.0:1789043001.590510:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242434560 00000100:00100000:1.0:1789043001.590590:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267624320 00000100:00100000:1.0:1789043001.590593:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267624320 00000100:00100000:1.0:1789043001.590637:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789043001.590648:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6fc24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875947267624320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789043001.590728:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6fc24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875947267624320:12345-0@lo:400:kworker.0 Request processed in 81us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043001.590736:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789043001.590760:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 88 00000100:00100000:1.0:1789043001.590769:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6fc27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+22:9985:x1875947242434560:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:1.0:1789043001.590791:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043001.590821:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06505 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca6769fc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.590950:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0650c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.590969:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c064f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769f5 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.590979:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0650c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.591029:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c064f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769f5 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.591045:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c064f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769f5 expref: 23 pid: 5845 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043001.591058:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a5289e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1875947267624832:192.168.203.17@tcp:104: 00000100:00100000:1.0:1789043001.591687:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a4733d9c0 going to sleep for 11 seconds 00000100:00080000:1.0:1789043001.593126:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789043001.593898:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6fc26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875947267624192:0@lo:400:kworker.0 00000100:00100000:3.0:1789043001.594336:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043001.594448:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6fc25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875947267624320:0@lo:400:kworker.0 00000100:00100000:3.0:1789043001.594530:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267624064 00000100:00100000:3.0:1789043001.594540:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267624064 00000100:00100000:3.0:1789043001.594601:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789043001.594611:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3314:x1875947267624064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789043001.594673:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3314:x1875947267624064:12345-0@lo:400:kworker.0 Request processed in 64us (4989us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043001.594681:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789043001.594895:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043001.594939:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06942104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3314:1875947267624064:0@lo:400:kworker.0 00000100:00100000:3.0:1789043001.594964:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267624576 00000100:00100000:3.0:1789043001.594969:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267624576 00000100:00100000:1.0:1789043001.595233:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267624448 00000100:00100000:1.0:1789043001.595239:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267624448 00000100:00100000:1.0:1789043001.595286:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789043001.595302:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a51877450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267624448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789043001.595335:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789043001.595364:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6fc25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875947267624576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789043001.595385:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a51877450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267624448:12345-0@lo:400:kworker.0 Request processed in 89us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043001.595393:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789043001.595486:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6fc25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875947267624576:12345-0@lo:400:kworker.0 Request processed in 135us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043001.595496:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789043001.596262:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1789043001.596271:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:3.0:1789043001.596294:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa06a79c7a680, transno 4294967301 00000100:00100000:3.0:1789043001.596313:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6fc25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267624448:0@lo:400:kworker.0 00000100:00080000:3.0:1789043001.596351:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789043001.596430:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789043001.596459:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6fc26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875947267624576:0@lo:400:kworker.0 00000100:00100000:2.0:1789043001.600457:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043001.600529:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6fc24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267624704:0@lo:400:kworker.0 00000100:00100000:2.0:1789043001.600575:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043001.600638:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267624192 00000100:00100000:2.0:1789043001.600645:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267624192 00000100:00100000:2.0:1789043001.600692:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789043001.600700:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875947267624192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789043001.600754:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875947267624192:12345-0@lo:400:kworker.0 Request processed in 54us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043001.600761:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789043001.606121:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267624704 00000100:00100000:2.0:1789043001.606138:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267624704 00000100:00100000:2.0:1789043001.606219:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789043001.606244:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52dfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1875947267624704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789043001.606344:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52dfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1875947267624704:12345-0@lo:400:kworker.0 Request processed in 102us (5766us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043001.606352:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789043001.606402:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6fc26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875947267624192:0@lo:400:kworker.0 00000100:00100000:2.0:1789043001.606417:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6fc24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267624704:0@lo:400:kworker.0 00000100:00080000:2.0:1789043001.606450:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789043001.608114:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043001.608144:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242434688 00000100:00100000:2.0:1789043001.608150:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242434688 00010000:00010000:2.0:1789043001.608194:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c064f0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769f5 expref: 24 pid: 5845 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043001.608230:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 47 00000100:00100000:2.0:1789043001.608240:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+24:2352:x1875947242434688:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789043001.608254:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789043001.608263:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c064f0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769f5 expref: 24 pid: 5845 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.608280:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c064f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769f5 expref: 24 pid: 5845 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.608304:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a55d80d00) 00010000:00010000:2.0:1789043001.608310:0:6705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0650c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.608320:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0650c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.608342:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0650c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.608364:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789043001.608415:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+24:2352:x1875947242434688:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 175us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043001.608422:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 47 00010000:00010000:2.0:1789043001.608563:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c064f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769f5 expref: 23 pid: 5845 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043001.608581:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a5289e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1875947267624832:192.168.203.17@tcp:104: 00010000:00010000:2.0:1789043001.608605:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0650c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.608615:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0650c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.608622:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0650c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789043001.608642:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789043001.608796:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06505 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769fc expref: 24 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.608813:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0650c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769fc expref: 23 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.608820:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a55d80d00) 00010000:00010000:2.0:1789043001.608829:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789043001.608832:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41686e00, rc 0) 00000100:00100000:2.0:1789043001.608870:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6fc27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+23:9985:x1875947242434560:12345-192.168.203.17@tcp:101:bash.0 Request processed in 18103us (19551us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1789043001.608877:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 88 00000100:00100000:2.0:1789043001.616243:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043001.617205:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242434944 00000100:00100000:0.0:1789043001.617217:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242434944 00000100:00100000:0.0:1789043001.617275:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 89 00000100:00100000:0.0:1789043001.617286:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52dfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+23:9985:x1875947242434944:12345-192.168.203.17@tcp:36:bash.0 00010000:00010000:0.0:1789043001.617577:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c0651a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043001.617596:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c0651a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043001.617610:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c0651a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789043001.617664:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1789043001.617691:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cbfd4576 reply state 00000000594812de transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c0651a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043001.617701:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789043001.617751:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1789043001.617859:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52dfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+27:9985:x1875947242434944:12345-192.168.203.17@tcp:36:bash.0 Request processed in 573us (1626us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1789043001.617866:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 89 00000020:00080000:0.0:1789043001.617884:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1789043001.619867:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c0651a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.619884:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c0651a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.619893:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c0651a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.619900:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a40031000 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043001.619905:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c0651a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.619914:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c0651a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.619931:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a55d80d00) 00010000:00010000:2.0:1789043001.619934:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043001.619940:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c0651a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.620034:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c0651a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043001.621658:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043001.621842:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242435072 00000100:00100000:0.0:1789043001.621852:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242435072 00000100:00100000:0.0:1789043001.621906:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 90 00000100:00100000:0.0:1789043001.621917:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+26:9985:x1875947242435072:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:0.0:1789043001.621941:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789043001.622195:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06521 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676a03 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043001.622258:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06521 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a03 expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043001.622273:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06521 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a03 expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043001.622292:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a55d80d00) 00010000:00010000:0.0:1789043001.622295:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789043001.622299:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a40031a00, rc 0) 00000100:00100000:0.0:1789043001.622370:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+27:9985:x1875947242435072:12345-192.168.203.17@tcp:101:bash.0 Request processed in 454us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043001.622378:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 90 00000100:00100000:3.0:1789043001.625833:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043001.625919:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242435200 00000100:00100000:1.0:1789043001.625935:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242435200 00000100:00100000:1.0:1789043001.626149:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 33 00000100:00100000:1.0:1789043001.626162:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6fc26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:9985:x1875947242435200:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:1.0:1789043001.626181:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043001.626203:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000504581/0x99260d7389c06528 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676a0a expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789043001.626229:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa2a135, atime: 0x6aa2a133, ctime: 0x6aa2a135, blocks: 0xb 00010000:00010000:1.0:1789043001.626250:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=344s v=(0 0) 00010000:00010000:1.0:1789043001.626255:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789043001.626264:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000504581/0x99260d7389c06528 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a0a expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.626284:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000000504581/0x99260d7389c06528 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a0a expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043001.626297:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41687200, rc 0) 00000100:00100000:1.0:1789043001.626365:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6fc26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:9985:x1875947242435200:12345-192.168.203.17@tcp:101:bash.0 Request processed in 207us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043001.626387:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 33 00000100:00080000:2.0:1789043001.626462:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789043001.630338:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043001.630439:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242435328 00000100:00100000:1.0:1789043001.630449:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242435328 00002000:00010000:1.0:1789043001.630492:0:6695:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1789043001.630497:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa06a52dfc380 with x1875947242435328 ext(0->18446744073709551615) 00002000:00010000:1.0:1789043001.630509:0:6695:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa06a52dfc380. 00000100:00100000:1.0:1789043001.631086:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 1 00000100:00100000:1.0:1789043001.631102:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52dfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2350:x1875947242435328:12345-192.168.203.17@tcp:10:bash.0 00002000:00010000:1.0:1789043001.631381:0:6695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789043001.631386:0:6695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789042997 -> 1789043001 00002000:00010000:1.0:1789043001.631389:0:6695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1789042995 -> 1789042995 00002000:00010000:1.0:1789043001.631391:0:6695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789042997 -> 1789043001 00002000:00010000:1.0:1789043001.631393:0:6695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1789043001.631455:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52dfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:2350:x1875947242435328:12345-192.168.203.17@tcp:10:bash.0 Request processed in 359us (1126us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789043001.631464:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 1 00002000:00010000:1.0:1789043001.631470:0:6695:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1789043001.631474:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa06a52dfc380 with x1875947242435328 ext(0->18446744073709551615) 00002000:00010000:1.0:1789043001.631479:0:6695:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa06a52dfc380. 00010000:00010000:3.0:1789043001.715351:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789043001.723040:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043001.723154:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242435456 00000100:00100000:2.0:1789043001.723173:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242435456 00000100:00100000:2.0:1789043001.723244:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 91 00000100:00100000:2.0:1789043001.723255:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6fc25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+27:10480:x1875947242435456:12345-192.168.203.17@tcp:34:lfs.0 00010000:00010000:2.0:1789043001.723330:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c0652f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.723349:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c0652f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.723362:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c0652f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.723379:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06536 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.723386:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06536 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.723393:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06536 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.723634:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c0653d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.723644:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c0653d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.723650:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c0653d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789043001.723686:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c0653d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.723706:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c0652f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.723713:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c0652f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.723720:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c0652f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.723726:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979800 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043001.723731:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c0652f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.723739:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c0652f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.723751:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa06a44e19c00) 00010000:00010000:2.0:1789043001.723753:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043001.723758:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c0652f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.723765:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c0652f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.723777:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06536 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.723783:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06536 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.723789:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06536 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.723801:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979400 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043001.723804:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06536 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.723810:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06536 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.723818:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa06a457d3400) 00010000:00010000:2.0:1789043001.723820:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043001.723823:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06536 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.723844:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06536 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.723860:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c0653d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.723866:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c0653d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.723871:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c0653d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.723877:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50978600 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043001.723879:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c0653d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.723885:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c0653d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.723903:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a55d80d00) 00010000:00010000:2.0:1789043001.723906:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043001.723909:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c0653d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.723915:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c0653d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043001.726023:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6fc25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+27:10480:x1875947242435456:12345-192.168.203.17@tcp:34:lfs.0 Request processed in 2751us (2981us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043001.726036:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 91 00000100:00100000:3.0:1789043001.768415:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043001.768564:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242435712 00000100:00100000:2.0:1789043001.768575:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242435712 00000100:00100000:2.0:1789043001.768642:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 92 00000100:00100000:2.0:1789043001.768653:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6fc26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+27:10483:x1875947242435712:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:2.0:1789043001.768675:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043001.768696:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06544 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676a11 expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.768769:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c0654b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.768785:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c0654b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.768797:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c0654b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.768821:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06552 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.768843:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06552 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.768850:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06552 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.769114:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c06559 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.769124:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c06559 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.769131:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c06559 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789043001.769141:0:11703:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789043001.769229:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c0654b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.769236:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c0654b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.769243:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c0654b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.769249:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979400 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043001.769253:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c0654b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.769261:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c0654b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.769283:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa06a44e19c00) 00010000:00010000:2.0:1789043001.769285:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043001.769290:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c0654b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.769297:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c0654b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.769311:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06552 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.769317:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06552 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.769322:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06552 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.769328:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979800 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043001.769331:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06552 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.769337:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06552 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.769344:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa06a457d3400) 00010000:00010000:2.0:1789043001.769346:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043001.769349:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06552 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.769354:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06552 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.769405:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06544 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a11 expref: 30 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.769418:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c06559 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a11 expref: 29 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.769432:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a55d80d00) 00010000:00010000:2.0:1789043001.769434:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789043001.769436:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50978000, rc 0) 00000100:00100000:2.0:1789043001.769495:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6fc26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+29:10483:x1875947242435712:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 843us (1089us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1789043001.769503:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 92 00000100:00100000:3.0:1789043001.778012:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043001.778164:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242435840 00000100:00100000:0.0:1789043001.778174:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242435840 00000100:00100000:0.0:1789043001.778232:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 93 00000100:00100000:0.0:1789043001.778242:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6fc27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+29:10483:x1875947242435840:12345-192.168.203.17@tcp:54:lfs.0 00010000:00010000:0.0:1789043001.778309:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06567 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043001.778342:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0650c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769fc expref: 29 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043001.778352:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06567 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043001.778385:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0650c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769fc expref: 29 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043001.778398:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0650c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769fc expref: 29 pid: 5847 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043001.778411:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875947267624960:192.168.203.17@tcp:104: 00000100:00100000:0.0:1789043001.778507:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7726c480 going to sleep for 11 seconds 00000100:00100000:0.0:1789043001.786486:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043001.787405:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875947267624960:192.168.203.17@tcp:104: 00010000:00010000:2.0:1789043001.787432:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06567 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043001.787552:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242436096 00000100:00100000:1.0:1789043001.787560:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242436096 00000100:00100000:1.0:1789043001.787613:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 22 00000100:00100000:1.0:1789043001.787622:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+30:5592:x1875947242436096:12345-192.168.203.17@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789043001.788385:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+31:5592:x1875947242436096:12345-192.168.203.17@tcp:35:ldlm_bl.0 Request processed in 760us (1916us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1789043001.788408:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 22 00000100:00100000:1.0:1789043001.799164:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043001.799295:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242436224 00000100:00100000:2.0:1789043001.799305:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242436224 00010000:00010000:2.0:1789043001.799347:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0650c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769fc expref: 31 pid: 5847 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043001.799439:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 48 00000100:00100000:2.0:1789043001.799450:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5289ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+31:2351:x1875947242436224:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789043001.799465:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789043001.799620:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0650c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769fc expref: 31 pid: 5847 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.799653:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0650c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769fc expref: 31 pid: 5847 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.799675:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0650c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769fc expref: 31 pid: 5847 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.799691:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a55d80d00) 00010000:00010000:2.0:1789043001.799696:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06567 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.799705:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06567 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.799713:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06567 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.799739:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789043001.799798:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5289ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+30:2351:x1875947242436224:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 350us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043001.799806:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 48 00010000:00010000:0.0:1789043001.799876:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06567 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043001.799885:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06567 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043001.799915:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06567 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043001.799922:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06567 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043001.799928:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06567 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043001.799944:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a40031c00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789043001.799965:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06567 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043001.799973:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06567 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043001.799981:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a55d80d00) 00010000:00010000:0.0:1789043001.799984:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789043001.799987:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06567 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043001.799992:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06567 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043001.800044:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6fc27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+29:10483:x1875947242435840:12345-192.168.203.17@tcp:54:lfs.0 Request processed in 21804us (22049us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043001.800052:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 93 00000100:00100000:3.0:1789043001.806655:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043001.806786:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242436480 00000100:00100000:0.0:1789043001.806795:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242436480 00000100:00100000:0.0:1789043001.806837:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 23 00000100:00100000:0.0:1789043001.806846:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6fc24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+29:10483:x1875947242436480:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:0.0:1789043001.807280:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6fc24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+30:10483:x1875947242436480:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 235us (432us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1789043001.807289:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 23 00000100:00100000:1.0:1789043001.916274:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043001.916418:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242436736 00000100:00100000:2.0:1789043001.916432:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242436736 00000100:00100000:2.0:1789043001.916566:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 94 00000100:00100000:2.0:1789043001.916579:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5289e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+30:10494:x1875947242436736:12345-192.168.203.17@tcp:101:cat.0 00010000:00010000:2.0:1789043001.916612:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043001.916640:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c0656e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676a18 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.916765:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06575 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.916784:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06575 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.916798:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06575 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.916816:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c0657c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.916824:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c0657c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.916831:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c0657c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.917167:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06583 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.917178:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06583 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.917185:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06583 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789043001.917195:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1789043001.917312:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06575 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.917320:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06575 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.917335:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06575 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.917341:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979400 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043001.917346:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06575 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.917354:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06575 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.917367:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa06a44e19c00) 00010000:00010000:2.0:1789043001.917370:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043001.917375:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06575 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.917383:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06575 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.917396:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c0657c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.917402:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c0657c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.917408:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c0657c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.917414:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979e00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043001.917417:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c0657c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.917433:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c0657c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.917442:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa06a457d3400) 00010000:00010000:2.0:1789043001.917444:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043001.917447:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c0657c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.917454:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c0657c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.917507:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c0656e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a18 expref: 33 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.917572:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06583 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a18 expref: 32 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.917579:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a55d80d00) 00010000:00010000:2.0:1789043001.917581:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789043001.917584:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50978600, rc 0) 00000100:00100000:2.0:1789043001.917668:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5289e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+32:10494:x1875947242436736:12345-192.168.203.17@tcp:101:cat.0 Request processed in 1092us (1410us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1789043001.917678:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 94 00000100:00100000:3.0:1789043001.921999:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043001.922096:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242436992 00000100:00100000:1.0:1789043001.922132:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242436992 00000100:00100000:1.0:1789043001.922211:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 24 00000100:00100000:1.0:1789043001.922225:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6fc25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+32:10494:x1875947242436992:12345-192.168.203.17@tcp:35:cat.0 00000100:00100000:1.0:1789043001.922599:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6fc25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+33:10494:x1875947242436992:12345-192.168.203.17@tcp:35:cat.0 Request processed in 377us (613us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1789043001.922608:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 24 00000100:00100000:3.0:1789043001.957500:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043001.957610:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242437248 00000100:00100000:2.0:1789043001.957627:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242437248 00000100:00100000:2.0:1789043001.957713:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 95 00000100:00100000:2.0:1789043001.957725:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6fc25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+33:10495:x1875947242437248:12345-192.168.203.17@tcp:36:rm.0 00010000:00010000:2.0:1789043001.957847:0:6714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789043001.957895:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06583 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a18 expref: 33 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.957923:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c06559 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a11 expref: 32 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.957937:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06521 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a03 expref: 31 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.957950:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a55d80d00) 00010000:00010000:2.0:1789043001.957963:0:6714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789043001.957990:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06591 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.958015:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06591 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.958027:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06591 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.958044:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c06598 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.958051:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c06598 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.958058:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c06598 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.958737:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c0659f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.958750:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c0659f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.958760:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c0659f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789043001.959658:0:6714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1789043001.959673:0:6714:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 344916158135ns, next at 345916154675ns, rc = 0 00010000:00010000:2.0:1789043001.959750:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979c00/0x99260d7389c065a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.959763:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979c00/0x99260d7389c065a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.959774:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979c00/0x99260d7389c065a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.959782:0:6714:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979c00/0x99260d7389c065a6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.959789:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979c00/0x99260d7389c065a6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.959798:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979c00/0x99260d7389c065a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.959827:0:6714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789043001.959854:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c0659f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.962205:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c0659f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.962214:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c0659f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.962221:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979400 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043001.962227:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c0659f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.962239:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c0659f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.962265:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a457d3700) 00010000:00010000:2.0:1789043001.962268:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789043001.962277:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c0659f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.962286:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c0659f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.962311:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789043001.962330:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06591 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.962331:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979c00/0x99260d7389c065a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.962361:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979c00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:3.0:1789043001.962366:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979c00/0x99260d7389c065a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.962377:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979c00/0x99260d7389c065a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.962407:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06591 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.962412:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa06a457d3700) 00010000:00010000:3.0:1789043001.962420:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789043001.962421:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06591 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.962428:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979c00/0x99260d7389c065a6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.962431:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979800 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789043001.962439:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979c00/0x99260d7389c065a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.962454:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06591 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.962463:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06591 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.962469:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043001.962473:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043001.962476:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa06a44e19c00) 00010000:00010000:3.0:1789043001.962477:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043001.962481:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043001.962485:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06591 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043001.962491:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06591 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789043001.962504:0:6714:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b4db7c6 reply state 00000000003e32d9 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c06598 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043001.962544:0:6714:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789043001.962701:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6fc25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+32:10495:x1875947242437248:12345-192.168.203.17@tcp:36:rm.0 Request processed in 4970us (5215us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1789043001.962716:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 95 00010000:00010000:3.0:1789043001.968377:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c06598 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.968395:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c06598 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.968403:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c06598 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.968411:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979e00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789043001.968415:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c06598 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.968424:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c06598 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.968439:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa06a457d3400) 00010000:00010000:3.0:1789043001.968442:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789043001.968447:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c06598 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043001.968473:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c06598 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043002.005619:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043002.005712:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242437504 00000100:00100000:0.0:1789043002.005721:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242437504 00000100:00100000:0.0:1789043002.005788:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 96 00000100:00100000:0.0:1789043002.005815:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6fc24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+31:10501:x1875947242437504:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:0.0:1789043002.005852:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789043002.005874:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c065ad lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676a1f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.005996:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c065b4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.006026:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c065b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.006037:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c065b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.006051:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c065bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.006058:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c065bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.006064:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c065bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789043002.006583:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1789043002.006738:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c065c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.006749:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c065c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.006756:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c065c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.006797:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c065b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.006804:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c065b4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.006811:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c065b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.006817:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a40031000 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789043002.006821:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c065b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.006828:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c065b4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.006840:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa06a44e19c00) 00010000:00010000:0.0:1789043002.006843:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789043002.006848:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c065b4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.006855:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c065b4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789043002.006868:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000091c4ee24 reply state 000000006bdc6f0f transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c065bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043002.006876:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789043002.006903:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c065ad lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a1f expref: 34 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.006929:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c065c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a1f expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.006936:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa06a55221100) 00010000:00010000:0.0:1789043002.006939:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789043002.006941:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a40031a00, rc 0) 00000100:00100000:0.0:1789043002.007015:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6fc24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+34:10501:x1875947242437504:12345-192.168.203.17@tcp:101:bash.0 Request processed in 1193us (1395us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1789043002.007023:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 96 00010000:00010000:2.0:1789043002.008908:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c065bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.008930:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c065bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.008938:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c065bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.008946:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a40031600 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043002.008951:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c065bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.008975:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c065bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.008995:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa06a55221d00) 00010000:00010000:2.0:1789043002.008998:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043002.009011:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c065bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.009018:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c065bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043002.011871:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043002.012016:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242437632 00000100:00100000:2.0:1789043002.012030:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242437632 00000100:00100000:2.0:1789043002.012130:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 34 00000100:00100000:2.0:1789043002.012143:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6fc27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2352:x1875947242437632:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:2.0:1789043002.012168:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043002.012197:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091dc7aae/0x99260d7389c065d0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676a26 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789043002.012234:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789043002.012272:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=344s v=(0 0) 00010000:00010000:2.0:1789043002.012278:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789043002.012290:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091dc7aae/0x99260d7389c065d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a26 expref: 6 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.012313:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000091dc7aae/0x99260d7389c065d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a26 expref: 6 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.012352:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50979800, rc 0) 00000100:00100000:2.0:1789043002.012421:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6fc27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2352:x1875947242437632:12345-192.168.203.17@tcp:101:bash.0 Request processed in 281us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043002.012429:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 34 00000100:00080000:3.0:1789043002.012790:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789043002.015754:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043002.015869:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242437760 00000100:00100000:3.0:1789043002.015882:0:8215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242437760 00000100:00100000:3.0:1789043002.015992:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 35 00000100:00100000:3.0:1789043002.016014:0:8215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5289dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:10501:x1875947242437760:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:3.0:1789043002.016038:0:8215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789043002.016063:0:8215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd91f474/0x99260d7389c065d7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676a2d expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043002.016104:0:8215:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000091dc7aae/0x99260d7389c065d0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a26 expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043002.016113:0:8215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789043002.016118:0:8215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789043002.016124:0:8215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd91f474/0x99260d7389c065d7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a2d expref: 7 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043002.016174:0:8215:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000091dc7aae/0x99260d7389c065d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a26 expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043002.016190:0:8215:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000091dc7aae/0x99260d7389c065d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a26 expref: 7 pid: 6692 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043002.016227:0:8215:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6fc27b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8215:1875947267625088:192.168.203.17@tcp:104: 00000100:00100000:3.0:1789043002.016413:0:8215:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a6ed9d780 going to sleep for 11 seconds 00000100:00100000:1.0:1789043002.025789:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043002.026038:0:8215:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6fc27b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8215:1875947267625088:192.168.203.17@tcp:104: 00010000:00010000:3.0:1789043002.026087:0:8215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cd91f474/0x99260d7389c065d7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a2d expref: 7 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043002.026112:0:8215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc29200, rc 0) 00000100:00100000:3.0:1789043002.026190:0:8215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5289dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:10501:x1875947242437760:12345-192.168.203.17@tcp:101:bash.0 Request processed in 10187us (10450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043002.026200:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 35 00000100:00100000:0.0:1789043002.027184:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242437888 00000100:00100000:0.0:1789043002.027198:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242437888 00010000:00010000:0.0:1789043002.027246:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000091dc7aae/0x99260d7389c065d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a26 expref: 7 pid: 6692 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043002.027332:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 49 00000100:00100000:0.0:1789043002.027344:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2352:x1875947242437888:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789043002.027362:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789043002.027393:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000091dc7aae/0x99260d7389c065d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a26 expref: 7 pid: 6692 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.027409:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000091dc7aae/0x99260d7389c065d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a26 expref: 7 pid: 6692 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.027811:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091dc7aae/0x99260d7389c065d0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a26 expref: 7 pid: 6692 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.027855:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043002.028141:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043002.028155:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cd91f474/0x99260d7389c065d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a2d expref: 6 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.028167:0:8457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd91f474/0x99260d7389c065d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a2d expref: 6 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.028223:0:8457:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cd91f474/0x99260d7389c065d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a2d expref: 6 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043002.028241:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8457:1875947267625216:192.168.203.17@tcp:105: 00000100:00100000:0.0:1789043002.028409:0:8457:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7726ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1789043002.032063:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8457:1875947267625216:192.168.203.17@tcp:105: 00010000:00010000:0.0:1789043002.032101:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789043002.032178:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2352:x1875947242437888:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 4834us (6401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043002.032190:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 49 00000100:00100000:0.0:1789043002.034201:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043002.034300:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242438144 00000100:00100000:1.0:1789043002.034314:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242438144 00000100:00100000:1.0:1789043002.034424:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 25 00000100:00100000:1.0:1789043002.034438:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+33:10501:x1875947242438144:12345-192.168.203.17@tcp:35:bash.0 00000100:00100000:1.0:1789043002.034968:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+34:10501:x1875947242438144:12345-192.168.203.17@tcp:35:bash.0 Request processed in 530us (778us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1789043002.034978:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 25 00000100:00100000:3.0:1789043002.099063:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267625344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789043002.099174:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043002.099416:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267625344 00000100:00100000:0.0:1789043002.099428:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267625344 00000100:00100000:0.0:1789043002.099497:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789043002.099508:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6fc27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875947267625344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789043002.099586:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789043002.099789:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267625344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789043002.099841:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6fc27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875947267625344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 157us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043002.099850:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789043002.168760:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043002.168927:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242438272 00000100:00100000:2.0:1789043002.168951:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242438272 00000100:00100000:2.0:1789043002.169033:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 97 00000100:00100000:2.0:1789043002.169047:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+34:10517:x1875947242438272:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:2.0:1789043002.169086:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043002.169113:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c065de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676a34 expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.169208:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c065e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.169225:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c065e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.169241:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c065e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789043002.169409:0:11703:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789043002.169413:0:11703:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789043002.169437:0:11703:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c065e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.169468:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c065de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a34 expref: 36 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.169511:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c065e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a34 expref: 35 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.169562:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa06a44e19c00) 00010000:00010000:2.0:1789043002.169566:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789043002.169571:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50978600, rc 0) 00000100:00100000:2.0:1789043002.170107:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+35:10517:x1875947242438272:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 1058us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043002.170118:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 97 00000100:00100000:3.0:1789043002.179758:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043002.179967:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242438528 00000100:00100000:2.0:1789043002.179982:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242438528 00000100:00100000:2.0:1789043002.180074:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 98 00000100:00100000:2.0:1789043002.180088:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6fc25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+35:10517:x1875947242438528:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:2.0:1789043002.180116:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043002.180141:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c065ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676a3b expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.180290:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c065f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.180308:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c065f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.180323:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c065f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789043002.180336:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789043002.180562:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c065ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a3b expref: 38 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.180585:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c065f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a3b expref: 37 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.180595:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa06a55221100) 00010000:00010000:2.0:1789043002.180598:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789043002.180602:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50978800, rc 0) 00000100:00100000:2.0:1789043002.180685:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6fc25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+37:10517:x1875947242438528:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 600us (941us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1789043002.180693:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 98 00000100:00100000:1.0:1789043002.191100:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043002.191214:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242438784 00000100:00100000:0.0:1789043002.191229:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242438784 00000100:00100000:0.0:1789043002.191313:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 99 00000100:00100000:0.0:1789043002.191326:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5289ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+37:10517:x1875947242438784:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:0.0:1789043002.191360:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789043002.191389:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06601 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676a42 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043002.191395:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043002.191477:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242438912 00000100:00100000:2.0:1789043002.191483:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242438912 00000100:00100000:2.0:1789043002.191548:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 6 00000100:00100000:2.0:1789043002.191556:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6fc26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+39:2351:x1875947242438912:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789043002.191560:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06608 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.191567:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789043002.191576:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06608 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.191597:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06608 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789043002.191612:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789043002.199598:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c065f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a3b expref: 40 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.199709:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa06a55221100) 00010000:00010000:2.0:1789043002.199716:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789043002.199904:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6fc26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+39:2351:x1875947242438912:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 8346us (8506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043002.199916:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 6 00010000:00010000:0.0:1789043002.206960:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06601 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a42 expref: 39 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.207113:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06608 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a42 expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.207124:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa06a55221100) 00010000:00010000:0.0:1789043002.207150:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789043002.207155:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a40031c00, rc 0) 00000100:00100000:0.0:1789043002.207301:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5289ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+38:10517:x1875947242438784:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 15974us (16213us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1789043002.207311:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 99 00000100:00100000:3.0:1789043002.217503:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043002.219901:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242439040 00000100:00100000:0.0:1789043002.219922:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242439040 00000100:00100000:2.0:1789043002.220120:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 36 00000100:00100000:2.0:1789043002.220141:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6fc24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2349:x1875947242439040:12345-192.168.203.17@tcp:1:lfs.0 00010000:00010000:2.0:1789043002.220215:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005490156d/0x99260d7389c06616 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.220240:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cd91f474/0x99260d7389c065d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a2d expref: 6 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.220260:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789043002.220264:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789043002.220269:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005490156d/0x99260d7389c06616 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.220317:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cd91f474/0x99260d7389c065d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a2d expref: 6 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.220335:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cd91f474/0x99260d7389c065d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a2d expref: 6 pid: 8215 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043002.220353:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52dfed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6690:1875947267625472:192.168.203.17@tcp:104: 00000100:00100000:2.0:1789043002.220473:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a42ee4240 going to sleep for 11 seconds 00000100:00100000:1.0:1789043002.223996:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043002.224158:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52dfed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6690:1875947267625472:192.168.203.17@tcp:104: 00010000:00010000:2.0:1789043002.224193:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005490156d/0x99260d7389c06616 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043002.224285:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242439168 00000100:00100000:3.0:1789043002.224297:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242439168 00002000:00100000:3.0:1789043002.224355:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffffa06a5289fb80 x1875947242439168/t0(0) o4->3fb32839-ebfd-4c0f-90e4-f036c86704df@192.168.203.17@tcp:298/0 lens 504/0 e 0 to 0 dl 1789043013 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789043002.224365:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa06a5289fb80 with x1875947242439168 ext(0->8) 00010000:00010000:3.0:1789043002.224373:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cd91f474/0x99260d7389c065d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a2d expref: 7 pid: 8215 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043002.224389:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cd91f474/0x99260d7389c065d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a2d expref: 7 pid: 8215 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789043002.224414:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa06a5289fb80 00000100:00100000:3.0:1789043002.224455:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 1 00000100:00100000:3.0:1789043002.224467:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5289fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2352:x1875947242439168:12345-192.168.203.17@tcp:4:lfs.0 00000100:00100000:3.0:1789043002.225284:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5289fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+9:2352:x1875947242439168:12345-192.168.203.17@tcp:4:lfs.0 Request processed in 815us (1300us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789043002.225296:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 1 00002000:00100000:3.0:1789043002.225306:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffffa06a5289fb80 x1875947242439168/t4294967302(0) o4->3fb32839-ebfd-4c0f-90e4-f036c86704df@192.168.203.17@tcp:298/0 lens 504/448 e 0 to 0 dl 1789043013 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789043002.225316:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa06a5289fb80 with x1875947242439168 ext(0->8) 00010000:00010000:3.0:1789043002.225324:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cd91f474/0x99260d7389c065d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a2d expref: 9 pid: 8215 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043002.225342:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cd91f474/0x99260d7389c065d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a2d expref: 9 pid: 8215 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789043002.225350:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa06a5289fb80 00000100:00100000:3.0:1789043002.229122:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043002.229289:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242439296 00000100:00100000:2.0:1789043002.229303:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242439296 00010000:00010000:2.0:1789043002.229356:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cd91f474/0x99260d7389c065d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a2d expref: 9 pid: 8215 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043002.229503:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 50 00000100:00100000:2.0:1789043002.229571:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6fc24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+9:2351:x1875947242439296:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789043002.229593:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789043002.229620:0:5832:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789043002.229623:0:5832:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789043002 00002000:00010000:2.0:1789043002.229626:0:5832:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789043002 00002000:00010000:2.0:1789043002.229628:0:5832:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789043002 00010000:00010000:2.0:1789043002.229636:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cd91f474/0x99260d7389c065d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a2d expref: 9 pid: 8215 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.229652:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cd91f474/0x99260d7389c065d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a2d expref: 9 pid: 8215 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.229696:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd91f474/0x99260d7389c065d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a2d expref: 9 pid: 8215 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.229717:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789043002.229723:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789043002.229730:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005490156d/0x99260d7389c06616 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.229741:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005490156d/0x99260d7389c06616 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.229780:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789043002.229850:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6fc24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:2351:x1875947242439296:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 335us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043002.229860:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 50 00010000:00010000:3.0:1789043002.230225:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005490156d/0x99260d7389c06616 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043002.230236:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005490156d/0x99260d7389c06616 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043002.230270:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005490156d/0x99260d7389c06616 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043002.230288:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005490156d/0x99260d7389c06616 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043002.230296:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005490156d/0x99260d7389c06616 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043002.230304:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50978800 already unused, calling callback (ffffffffc1470760) 00010000:00010000:3.0:1789043002.230310:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005490156d/0x99260d7389c06616 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043002.230321:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005490156d/0x99260d7389c06616 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043002.230336:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005490156d/0x99260d7389c06616 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043002.230345:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005490156d/0x99260d7389c06616 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043002.230420:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6fc24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2349:x1875947242439040:12345-192.168.203.17@tcp:1:lfs.0 Request processed in 10280us (12947us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043002.230430:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 36 00000100:00100000:3.0:1789043002.235408:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043002.235873:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242439552 00000100:00100000:0.0:1789043002.236018:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242439552 00000100:00100000:1.0:1789043002.238858:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 26 00000100:00100000:1.0:1789043002.238888:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a50c22050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+38:10517:x1875947242439552:12345-192.168.203.17@tcp:35:lfs.0 00000004:00010000:1.0:1789043002.239012:0:5848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06608 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a42 expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789043002.239323:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1789043002.239358:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1789043002.239795:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1789043002.240230:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c0661d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.240265:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c065c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a1f expref: 42 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.240276:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c0661d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.240323:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c065c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a1f expref: 42 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.240342:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c065c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a1f expref: 42 pid: 5846 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043002.240359:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a5289d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1875947267625600:192.168.203.17@tcp:104: 00000100:00100000:1.0:1789043002.240496:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a52c9ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789043002.245258:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a5289d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1875947267625600:192.168.203.17@tcp:104: 00010000:00010000:3.0:1789043002.245328:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c0661d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043002.246503:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043002.247086:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242439680 00000100:00100000:2.0:1789043002.247100:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242439680 00010000:00010000:2.0:1789043002.247158:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c065c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a1f expref: 43 pid: 5846 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043002.247202:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 51 00000100:00100000:2.0:1789043002.247213:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+43:2352:x1875947242439680:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789043002.247232:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789043002.247239:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c065c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a1f expref: 43 pid: 5846 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.247257:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c065c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a1f expref: 43 pid: 5846 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.247287:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c065c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a1f expref: 43 pid: 5846 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.247307:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa06a55221100) 00010000:00010000:2.0:1789043002.247314:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c0661d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.247325:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c0661d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.247334:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c0661d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.247382:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789043002.248728:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+42:2352:x1875947242439680:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 1504us (2282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043002.248742:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 51 00010000:00010000:1.0:1789043002.248906:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c0661d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.248919:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c0661d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789043002.249101:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1789043002.249380:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1789043002.249609:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a5289c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1875947267625728:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789043002.249684:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043002.249724:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a585aed80 going to sleep for 11 seconds 00000100:00100000:3.0:1789043002.249766:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267625728 00000100:00100000:3.0:1789043002.249777:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267625728 00000100:00100000:3.0:1789043002.249833:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789043002.249844:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5289d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1875947267625728:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789043002.249957:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5289d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1875947267625728:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 115us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043002.249964:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789043002.250814:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a5289c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1875947267625728:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789043002.252037:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1789043002.252148:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a5289c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1875947267625856:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789043002.252222:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043002.252335:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7a8e56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789043002.252779:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267625856 00000100:00100000:3.0:1789043002.252790:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267625856 00000100:00100000:3.0:1789043002.252861:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789043002.252873:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5289ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1875947267625856:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789043002.253134:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5289ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5848:x1875947267625856:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 263us (911us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789043002.253142:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789043002.253300:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a5289c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1875947267625856:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789043002.253377:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1789043002.253431:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c0661d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.253445:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c0661d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.253453:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c0661d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.253460:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687400 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043002.253464:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c0661d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.253490:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c0661d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.253543:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa06a55221100) 00010000:00010000:1.0:1789043002.253547:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789043002.253570:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c0661d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.253578:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c0661d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789043002.253810:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789043002.253971:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1789043002.253987:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 345210471389ns, next at 346210467968ns, rc = 0 00000001:00080000:1.0:1789043002.253994:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1789043002.254044:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa06a55221100) 00010000:00010000:1.0:1789043002.254047:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789043002.254056:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06608 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a42 expref: 46 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043002.254189:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a50c22050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+45:10517:x1875947242439552:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 15317us (18796us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1789043002.254199:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 26 00000020:00080000:1.0:1789043002.254204:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789043002.257123:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043002.257238:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242439808 00000100:00100000:2.0:1789043002.257319:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242439808 00000100:00100000:2.0:1789043002.257398:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 100 00000100:00100000:2.0:1789043002.257409:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+45:10517:x1875947242439808:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:2.0:1789043002.257442:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043002.257702:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c06624 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676a49 expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.257785:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c06624 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a49 expref: 46 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.257802:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c06624 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a49 expref: 46 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.257824:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa06a457d3600) 00010000:00010000:2.0:1789043002.257827:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789043002.257832:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50978000, rc 0) 00000100:00100000:2.0:1789043002.258141:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+46:10517:x1875947242439808:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 732us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043002.258149:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 100 00000100:00100000:0.0:1789043002.263231:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043002.263382:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242440064 00000100:00100000:2.0:1789043002.263395:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242440064 00000100:00100000:2.0:1789043002.263505:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 27 00000100:00100000:2.0:1789043002.263556:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+46:10517:x1875947242440064:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:2.0:1789043002.264104:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+47:10517:x1875947242440064:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 585us (883us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1789043002.264114:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 27 00000100:00100000:0.0:1789043002.352660:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043002.352776:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242440192 00000100:00100000:2.0:1789043002.352790:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242440192 00000100:00100000:2.0:1789043002.352868:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 101 00000100:00100000:2.0:1789043002.352880:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+47:10527:x1875947242440192:12345-192.168.203.17@tcp:34:lfs.0 00010000:00010000:2.0:1789043002.352981:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c0662b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.353014:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c0662b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.353030:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c0662b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.353049:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c06632 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.353058:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c06632 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.353065:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c06632 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.353178:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06639 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.353210:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.353219:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789043002.353275:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.353290:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c0662b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.353299:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c0662b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.353307:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c0662b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.353315:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979a00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043002.353321:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c0662b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.353330:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c0662b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.353343:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa06a44e19c00) 00010000:00010000:2.0:1789043002.353347:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043002.353354:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c0662b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.353362:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c0662b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.353388:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c06632 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.353395:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c06632 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.353402:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c06632 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.353409:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50978400 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043002.353412:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c06632 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.353419:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c06632 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.353427:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa06a457d3b00) 00010000:00010000:2.0:1789043002.353430:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043002.353434:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c06632 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.353440:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c06632 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.353458:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.353465:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06639 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.353471:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06639 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.353484:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50978e00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043002.353488:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06639 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.353494:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06639 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.353503:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa06a457d3600) 00010000:00010000:2.0:1789043002.353506:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043002.353509:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06639 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.353578:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06639 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043002.353683:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+47:10527:x1875947242440192:12345-192.168.203.17@tcp:34:lfs.0 Request processed in 803us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043002.353692:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 101 00000100:00100000:0.0:1789043002.389966:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043002.390102:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242440448 00000100:00100000:2.0:1789043002.390115:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242440448 00000100:00100000:2.0:1789043002.390192:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 102 00000100:00100000:2.0:1789043002.390204:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+47:10530:x1875947242440448:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:2.0:1789043002.390230:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043002.390268:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06640 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676a50 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.390362:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c06647 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.390403:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c06647 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.390418:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c06647 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.390436:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c0664e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.390444:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c0664e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.390451:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c0664e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.390855:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06655 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.390866:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06655 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.390875:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06655 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789043002.390887:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789043002.391058:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c06647 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.391067:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c06647 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.391075:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c06647 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.391088:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50978400 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043002.391093:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c06647 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.391103:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c06647 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.391116:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa06a44e19c00) 00010000:00010000:2.0:1789043002.391120:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043002.391125:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c06647 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.391133:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c06647 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.391150:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c0664e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.391157:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c0664e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.391163:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c0664e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.391168:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979a00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043002.391171:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c0664e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.391178:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c0664e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.391196:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa06a457d3b00) 00010000:00010000:2.0:1789043002.391199:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043002.391203:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c0664e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.391209:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c0664e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.391333:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06640 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a50 expref: 50 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.391350:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06655 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a50 expref: 49 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.391359:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa06a457d3600) 00010000:00010000:2.0:1789043002.391362:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789043002.391365:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50979200, rc 0) 00000100:00100000:2.0:1789043002.391444:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+49:10530:x1875947242440448:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 1242us (1494us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1789043002.391454:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 102 00000100:00100000:3.0:1789043002.395707:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043002.395831:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242440576 00000100:00100000:2.0:1789043002.395844:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242440576 00000100:00100000:2.0:1789043002.395915:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 103 00000100:00100000:2.0:1789043002.395929:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6fc26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+49:10530:x1875947242440576:12345-192.168.203.17@tcp:54:lfs.0 00010000:00010000:2.0:1789043002.396036:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c06663 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.396059:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c06663 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.396093:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c06663 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.396128:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c06663 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.396136:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c06663 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.396144:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c06663 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.396151:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50978a00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043002.396157:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c06663 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.396166:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c06663 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.396179:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa06a457d3600) 00010000:00010000:2.0:1789043002.396182:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789043002.396189:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c06663 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.396195:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c06663 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043002.396294:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6fc26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+49:10530:x1875947242440576:12345-192.168.203.17@tcp:54:lfs.0 Request processed in 367us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043002.396302:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 103 00000100:00100000:0.0:1789043002.399773:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043002.399889:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242440832 00000100:00100000:1.0:1789043002.399902:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242440832 00000100:00100000:1.0:1789043002.399977:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 28 00000100:00100000:1.0:1789043002.399990:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+49:10530:x1875947242440832:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:1.0:1789043002.400327:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+50:10530:x1875947242440832:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 339us (569us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1789043002.400336:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 28 00000100:00100000:0.0:1789043002.479559:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043002.479672:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242441088 00000100:00100000:1.0:1789043002.479686:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242441088 00000100:00100000:1.0:1789043002.479773:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 104 00000100:00100000:1.0:1789043002.479807:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+50:10540:x1875947242441088:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:1.0:1789043002.479843:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043002.479847:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789043002.479886:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c065e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a34 expref: 50 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.479913:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa06a44e19c00) 00010000:00010000:1.0:1789043002.479920:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789043002.479939:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c0666a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676a57 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.480099:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06671 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.480117:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06655 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a50 expref: 50 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.480126:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06671 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.480179:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06655 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a50 expref: 50 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.480196:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06655 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a50 expref: 50 pid: 5846 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043002.480214:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a5289e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875947267625984:192.168.203.17@tcp:104: 00000100:00100000:1.0:1789043002.480344:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7a8e5780 going to sleep for 11 seconds 00000100:00100000:1.0:1789043002.485206:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a5289e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875947267625984:192.168.203.17@tcp:104: 00010000:00010000:1.0:1789043002.485268:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06671 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043002.486680:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043002.486790:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242441216 00000100:00100000:2.0:1789043002.486803:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242441216 00010000:00010000:2.0:1789043002.486855:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06655 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a50 expref: 51 pid: 5846 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043002.486902:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 52 00000100:00100000:2.0:1789043002.486913:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+51:2351:x1875947242441216:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789043002.486932:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789043002.486940:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06655 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a50 expref: 51 pid: 5846 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.486955:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06655 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a50 expref: 51 pid: 5846 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.486981:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06655 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a50 expref: 51 pid: 5846 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.487021:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa06a457d3600) 00010000:00010000:2.0:1789043002.487027:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06671 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.487039:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06671 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.487049:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06671 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.487086:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789043002.487168:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+50:2351:x1875947242441216:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 255us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043002.487199:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 52 00010000:00010000:1.0:1789043002.488283:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06671 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.488300:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06671 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789043002.488329:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789043002.488582:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c0666a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a57 expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.488607:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06671 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a57 expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.488618:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa06a457d3600) 00010000:00010000:1.0:1789043002.488622:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789043002.488698:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41687e00, rc 0) 00000100:00100000:1.0:1789043002.488767:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+50:10540:x1875947242441088:12345-192.168.203.17@tcp:101:bash.0 Request processed in 8962us (9255us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1789043002.488777:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 104 00000100:00100000:3.0:1789043002.491923:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043002.492144:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242441472 00000100:00100000:2.0:1789043002.492158:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242441472 00000100:00100000:2.0:1789043002.492238:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 105 00000100:00100000:2.0:1789043002.492251:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6fc24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+50:10540:x1875947242441472:12345-192.168.203.17@tcp:36:bash.0 00010000:00010000:2.0:1789043002.492733:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c0667f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.492758:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c0667f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.492772:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c0667f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789043002.492838:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1789043002.492867:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004e59c8a3 reply state 00000000964b02c0 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c0667f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043002.492878:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789043002.493769:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6fc24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+53:10540:x1875947242441472:12345-192.168.203.17@tcp:36:bash.0 Request processed in 1512us (1853us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1789043002.493783:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 105 00000020:00080000:2.0:1789043002.493790:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789043002.496780:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043002.496977:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242441600 00000100:00100000:2.0:1789043002.497008:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242441600 00000100:00100000:2.0:1789043002.497086:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 106 00000100:00100000:2.0:1789043002.497099:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6fc25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+53:10540:x1875947242441600:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:2.0:1789043002.497140:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043002.497188:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06686 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676a5e expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.497320:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c0668d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.497337:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06671 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a57 expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.497347:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c0667f lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.497355:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c0668d lrc: 5/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.497378:0:6714:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c0667f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.497411:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06671 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a57 expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.497427:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06671 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a57 expref: 54 pid: 5845 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043002.497443:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52dfed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875947267626112:192.168.203.17@tcp:104: 00000100:00100000:2.0:1789043002.497596:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a42ee4840 going to sleep for 11 seconds 00010000:00010000:1.0:1789043002.497773:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c0667f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.497785:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c0667f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.497793:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c0667f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.497807:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50978a00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043002.497811:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c0667f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.497821:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c0667f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.497840:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa06a457d3600) 00010000:00010000:1.0:1789043002.497844:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043002.497847:0:3299:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c0668d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.497857:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c0667f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.497864:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c0667f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043002.502898:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043002.503041:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242441728 00000100:00100000:0.0:1789043002.503055:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242441728 00010000:00010000:0.0:1789043002.503107:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06671 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a57 expref: 54 pid: 5845 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043002.503160:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 53 00000100:00100000:0.0:1789043002.503172:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942106680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+54:2352:x1875947242441728:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789043002.503191:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789043002.503199:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06671 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a57 expref: 54 pid: 5845 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.503242:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06671 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a57 expref: 54 pid: 5845 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.503273:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa06a457d3600) 00010000:00010000:0.0:1789043002.503279:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c0668d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.503289:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c0668d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.503298:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c0668d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.503325:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789043002.503395:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942106680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+54:2352:x1875947242441728:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 225us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043002.503403:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 53 00010000:00010000:2.0:1789043002.507441:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06671 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a57 expref: 53 pid: 5845 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043002.507478:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52dfed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875947267626112:192.168.203.17@tcp:104: 00010000:00010000:2.0:1789043002.507889:0:6714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c0668d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.507919:0:6714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c0668d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.507926:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c0668d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789043002.507994:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789043002.508009:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789043002.508042:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c0668d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.508089:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06686 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a5e expref: 53 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.508108:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c0668d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a5e expref: 52 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.508118:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa06a457d3600) 00010000:00010000:2.0:1789043002.508121:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789043002.508126:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50978e00, rc 0) 00000100:00100000:2.0:1789043002.508462:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6fc25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+52:10540:x1875947242441600:12345-192.168.203.17@tcp:101:bash.0 Request processed in 11363us (11694us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043002.508474:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 106 00000100:00100000:3.0:1789043002.512897:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043002.514617:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242441984 00000100:00100000:1.0:1789043002.514638:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242441984 00000100:00100000:1.0:1789043002.514931:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 29 00000100:00100000:1.0:1789043002.515259:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942106d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+52:10540:x1875947242441984:12345-192.168.203.17@tcp:35:bash.0 00000100:00100000:1.0:1789043002.517509:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942106d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+53:10540:x1875947242441984:12345-192.168.203.17@tcp:35:bash.0 Request processed in 2244us (4613us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1789043002.517544:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 29 00000100:00100000:3.0:1789043002.569061:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043002.569248:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242442112 00000100:00100000:1.0:1789043002.569262:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242442112 00000100:00100000:1.0:1789043002.569342:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 107 00000100:00100000:1.0:1789043002.569354:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942104e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+53:10546:x1875947242442112:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1789043002.569406:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043002.569434:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06694 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676a65 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.569602:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0669b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.569621:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0669b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.569637:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0669b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789043002.569685:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789043002.569689:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789043002.569711:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0669b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.569740:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06694 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a65 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.569760:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0669b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a65 expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.569768:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa06a44e19c00) 00010000:00010000:1.0:1789043002.569771:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789043002.569776:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41686e00, rc 0) 00000100:00100000:1.0:1789043002.569852:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942104e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+54:10546:x1875947242442112:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 501us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043002.569860:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 107 00000100:00100000:0.0:1789043002.574820:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043002.574870:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043002.574919:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043002.575028:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242442240 00000100:00100000:2.0:1789043002.575041:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242442240 00000100:00100000:2.0:1789043002.575115:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 290 00000100:00100000:2.0:1789043002.575127:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2350:x1875947242442240:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1789043002.575234:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2350:x1875947242442240:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 109us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043002.575255:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 290 00000100:00100000:1.0:1789043002.575397:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242442496 00000100:00100000:1.0:1789043002.575403:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242442496 00000100:00100000:1.0:1789043002.575458:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 142 00000100:00100000:1.0:1789043002.575472:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2350:x1875947242442496:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1789043002.575536:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2350:x1875947242442496:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 47us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043002.575543:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 142 00000100:00100000:3.0:1789043002.575734:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242442368 00000100:00100000:3.0:1789043002.575740:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242442368 00000100:00100000:3.0:1789043002.575784:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 79 00000100:00100000:3.0:1789043002.575792:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:2350:x1875947242442368:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1789043002.575837:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:2350:x1875947242442368:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 46us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043002.575844:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 79 00000100:00080000:2.0:1789043002.576127:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789043002.576813:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043002.576903:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242442624 00000100:00100000:2.0:1789043002.576911:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242442624 00000100:00100000:2.0:1789043002.576963:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 108 00000100:00100000:2.0:1789043002.576972:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+54:10546:x1875947242442624:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:2.0:1789043002.576990:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043002.577025:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c066a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676a6c expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.577118:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c066a9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.577136:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c066a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.577150:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c066a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.577167:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c066b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.577175:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c066b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.577181:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c066b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.577307:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c066b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.577317:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c066b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.577326:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c066b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789043002.577370:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789043002.577375:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789043002.577397:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c066b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.577411:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c066b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.577420:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c066a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.577427:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c066a9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.577433:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c066a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.577452:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979a00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043002.577457:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c066a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.577466:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c066a9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.577827:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa06a44e19c00) 00010000:00010000:2.0:1789043002.577831:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043002.577838:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c066a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.577846:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c066a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.577862:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c066b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.577868:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c066b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.577874:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c066b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.577880:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50978400 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043002.577882:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c066b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.577889:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c066b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.577896:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa06a457d3b00) 00010000:00010000:2.0:1789043002.577898:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043002.577902:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c066b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.577907:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c066b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.577963:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c066a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a6c expref: 56 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.577978:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c066b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a6c expref: 55 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.577986:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa06a457d3600) 00010000:00010000:2.0:1789043002.577988:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789043002.577991:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50978a00, rc 0) 00000100:00100000:2.0:1789043002.578211:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+55:10546:x1875947242442624:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 1238us (1401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043002.578220:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 108 00000100:00100000:3.0:1789043002.582180:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043002.582277:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043002.582454:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242443008 00000100:00100000:0.0:1789043002.582475:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242443008 00000100:00100000:0.0:1789043002.582605:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 7 00000100:00100000:0.0:1789043002.582618:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+55:2352:x1875947242443008:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789043002.582639:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789043002.582672:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c066b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a6c expref: 55 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.582720:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa06a457d3600) 00010000:00010000:0.0:1789043002.582727:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789043002.582801:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+54:2352:x1875947242443008:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 185us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043002.582810:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 7 00000100:00100000:2.0:1789043002.584303:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242442880 00000100:00100000:2.0:1789043002.584320:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242442880 00000100:00100000:2.0:1789043002.584391:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 109 00000100:00100000:2.0:1789043002.584402:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+54:10546:x1875947242442880:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:2.0:1789043002.584427:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043002.584747:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c066be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676a73 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.584884:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c066c5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.584902:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c0668d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a5e expref: 55 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.584912:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c066c5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.584977:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c0668d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a5e expref: 55 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.584994:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c0668d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a5e expref: 55 pid: 6714 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043002.585022:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52dfed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875947267626240:192.168.203.17@tcp:104: 00000100:00100000:2.0:1789043002.585211:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a42ee4240 going to sleep for 11 seconds 00000100:00100000:3.0:1789043002.589262:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043002.589377:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52dfed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875947267626240:192.168.203.17@tcp:104: 00010000:00010000:2.0:1789043002.589414:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c066c5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043002.592254:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242443136 00000100:00100000:0.0:1789043002.592276:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242443136 00010000:00010000:0.0:1789043002.592344:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c0668d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a5e expref: 56 pid: 6714 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043002.592408:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 54 00000100:00100000:0.0:1789043002.592421:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46f89050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+56:2351:x1875947242443136:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789043002.592441:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789043002.592449:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c0668d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a5e expref: 56 pid: 6714 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.592464:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c0668d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a5e expref: 56 pid: 6714 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.592870:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c0668d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a5e expref: 56 pid: 6714 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.592898:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa06a457d3600) 00010000:00010000:0.0:1789043002.592905:0:6705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c066c5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.592944:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c066c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.592953:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c066c5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.592996:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789043002.593099:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46f89050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+55:2351:x1875947242443136:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 679us (3851us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043002.593109:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 54 00010000:00010000:2.0:1789043002.593278:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c066c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.593289:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c066c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789043002.593315:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789043002.593568:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c066be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a73 expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.593587:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c066c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a73 expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.593593:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa06a457d3600) 00010000:00010000:2.0:1789043002.593595:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789043002.593606:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50979600, rc 0) 00000100:00100000:2.0:1789043002.593637:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+55:10546:x1875947242442880:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 9238us (11471us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1789043002.593646:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 109 00000100:00100000:0.0:1789043002.597817:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043002.597946:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242443392 00000100:00100000:1.0:1789043002.597960:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242443392 00000100:00100000:1.0:1789043002.598057:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 8 00000100:00100000:1.0:1789043002.598079:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+55:10546:x1875947242443392:12345-192.168.203.17@tcp:103:lfs.0 00010000:00010000:1.0:1789043002.598100:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789043002.598132:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c06624 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a49 expref: 55 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.598157:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa06a457d3600) 00010000:00010000:1.0:1789043002.598163:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789043002.598235:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+54:10546:x1875947242443392:12345-192.168.203.17@tcp:103:lfs.0 Request processed in 168us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043002.598243:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 8 00000100:00100000:3.0:1789043002.601161:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043002.601330:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242443520 00000100:00100000:0.0:1789043002.601343:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242443520 00000100:00100000:0.0:1789043002.601418:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 110 00000100:00100000:0.0:1789043002.601429:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+54:10546:x1875947242443520:12345-192.168.203.17@tcp:58:lfs.0 00010000:00010000:0.0:1789043002.601652:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c066d3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.601676:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c066d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.601692:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c066d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789043002.601966:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1789043002.602096:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+54:10546:x1875947242443520:12345-192.168.203.17@tcp:58:lfs.0 Request processed in 666us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043002.602106:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 110 00000100:00100000:3.0:1789043002.605177:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043002.605787:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242443648 00000100:00100000:2.0:1789043002.605804:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242443648 00000100:00100000:2.0:1789043002.605874:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 111 00000100:00100000:2.0:1789043002.605887:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42f40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+54:10546:x1875947242443648:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:2.0:1789043002.605917:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043002.605946:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c066da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676a7a expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.606038:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c066d3 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.606052:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c066da lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a7a expref: 55 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.606146:0:6714:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c066d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.606163:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c066da lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a7a expref: 55 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.606180:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa06a457d3600) 00010000:00010000:2.0:1789043002.606184:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789043002.606187:0:6714:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c066da lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a7a expref: 55 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.606220:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50978400, rc 0) 00000100:00100000:2.0:1789043002.606422:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42f40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+55:10546:x1875947242443648:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 537us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043002.606430:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 111 00010000:00010000:0.0:1789043002.738824:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789043002.867472:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789043002.867484:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789043002.867602:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1789043002.867610:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789043002.867793:0:11689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a42f43100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1875947267626368:192.168.203.17@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789043002.868328:0:11689:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a6ed9d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789043002.876447:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043002.876549:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242443776 00000100:00100000:2.0:1789043002.876562:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242443776 00000100:00100000:3.0:1789043002.876648:0:11689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a42f43100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1875947267626368:192.168.203.17@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789043002.876648:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 112 00000100:00100000:2.0:1789043002.876666:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+56:10547:x1875947242443776:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789043002.876713:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789043002.876994:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+55:10547:x1875947242443776:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 Request processed in 331us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043002.877013:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 112 00000100:00100000:2.0:1789043002.881686:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043002.881859:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242443904 00000100:00100000:1.0:1789043002.881872:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242443904 00000100:00100000:1.0:1789043002.881960:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 113 00000100:00100000:1.0:1789043002.881971:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52dfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+55:10547:x1875947242443904:12345-192.168.203.17@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789043002.882091:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c066e1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.882136:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c066e1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.882151:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c066e1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.882924:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c066e8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.882948:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c066e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.882962:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c066e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.883007:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c066ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.883016:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c066ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.883022:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c066ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789043002.883071:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789043002.883075:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789043002.883089:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c066ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.883100:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c066e1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.883124:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c066e1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.883131:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c066e1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.883138:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687400 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043002.883142:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c066e1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.883150:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c066e1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.883162:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa06a44e19600) 00010000:00010000:1.0:1789043002.883165:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043002.883170:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c066e1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.883176:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c066e1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.883191:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c066e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.883198:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c066e8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.883203:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c066e8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.883209:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687000 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043002.883220:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c066e8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.883226:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c066e8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.883233:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffffa06a44e19900) 00010000:00010000:1.0:1789043002.883236:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043002.883239:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c066e8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.883244:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c066e8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.883261:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c066ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.883267:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c066ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.883272:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c066ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.883276:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687e00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043002.883279:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c066ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.883284:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c066ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.883291:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa06a457d3600) 00010000:00010000:1.0:1789043002.883293:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043002.883302:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c066ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.883308:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c066ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043002.883775:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52dfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+55:10547:x1875947242443904:12345-192.168.203.17@tcp:34:lhsmtool_posix.0 Request processed in 1801us (2097us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043002.883784:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 113 00000100:00100000:3.0:1789043002.895359:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043002.900596:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242444160 00000100:00100000:0.0:1789043002.900612:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242444160 00000100:00100000:0.0:1789043002.900685:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 114 00000100:00100000:0.0:1789043002.900696:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42f43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+55:10547:x1875947242444160:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789043002.900716:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789043002.900736:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c066f6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676a81 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.900845:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c066fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.900861:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c066fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.900873:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c066fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789043002.900889:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789043002.900988:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c066fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.900995:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c066fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.901013:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c066fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.901018:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a40031000 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789043002.901022:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c066fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.901045:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c066fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.901056:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa06a457d3600) 00010000:00010000:0.0:1789043002.901059:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789043002.901063:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c066fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.901069:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c066fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.901108:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c066f6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a81 expref: 57 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.901118:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa06a44e19600) 00010000:00010000:0.0:1789043002.901120:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789043002.901124:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c066f6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a81 expref: 57 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043002.901133:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a40031c00, rc 0) 00000100:00100000:0.0:1789043002.901197:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42f43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+56:10547:x1875947242444160:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 503us (5847us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1789043002.901205:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 114 00000100:00100000:3.0:1789043002.905025:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043002.905103:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242444288 00000100:00100000:0.0:1789043002.905114:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242444288 00000100:00100000:0.0:1789043002.905175:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 115 00000100:00100000:0.0:1789043002.905186:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42f40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+56:10547:x1875947242444288:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789043002.905242:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789043002.905362:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42f40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+56:10547:x1875947242444288:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 Request processed in 177us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043002.905371:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 115 00000100:00100000:1.0:1789043002.909967:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043002.910141:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242444544 00000100:00100000:3.0:1789043002.910151:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242444544 00000100:00100000:3.0:1789043002.910208:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 116 00000100:00100000:3.0:1789043002.910218:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5289e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+56:10547:x1875947242444544:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789043002.910238:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789043002.910241:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789043002.910265:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0669b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a65 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043002.910299:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa06a44e19c00) 00010000:00010000:3.0:1789043002.910304:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789043002.910317:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c0670b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676a88 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789043002.910772:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1789043002.910979:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29c00/0x99260d7389c06712 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043002.910993:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29c00/0x99260d7389c06712 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043002.911014:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29c00/0x99260d7389c06712 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043002.911065:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c0670b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a88 expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043002.911080:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29c00/0x99260d7389c06712 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a88 expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043002.911086:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa06a55d80a00) 00010000:00010000:3.0:1789043002.911089:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789043002.911091:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc29c00, rc 0) 00000100:00100000:3.0:1789043002.911158:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5289e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+57:10547:x1875947242444544:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 942us (1201us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1789043002.911166:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 116 00000100:00100000:3.0:1789043002.945836:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043002.946159:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242444800 00000100:00100000:2.0:1789043002.946169:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242444800 00000100:00100000:2.0:1789043002.946281:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 117 00000100:00100000:2.0:1789043002.946291:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42f42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+57:10547:x1875947242444800:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789043002.946349:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789043002.946376:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29c00/0x99260d7389c06712 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a88 expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.946396:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa06a55d80a00) 00010000:00010000:2.0:1789043002.946418:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789043002.946440:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06720 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.946465:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06720 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.946475:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06720 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.946575:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06727 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x10b981a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.946583:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06727 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x10b981a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.946590:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06727 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x10b981a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.946651:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06720 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.946659:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06720 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.946666:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06720 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.946672:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979a00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043002.946677:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06720 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.946685:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06720 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.946693:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa06a44e19c00) 00010000:00010000:2.0:1789043002.946702:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043002.946707:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06720 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.946713:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06720 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.946724:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06727 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x10b981a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.946730:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06727 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x10b981a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.946736:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06727 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x10b981a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.946741:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50978800 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043002.946744:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06727 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x10b981a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.946749:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06727 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x10b981a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.946757:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x10b981a7 (ffffa06a457d3b00) 00010000:00010000:2.0:1789043002.946759:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043002.946763:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06727 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x10b981a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.946768:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06727 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x10b981a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043002.946839:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42f42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+56:10547:x1875947242444800:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 Request processed in 549us (1012us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789043002.946852:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 117 00000100:00100000:1.0:1789043002.951959:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043002.953620:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242444928 00000100:00100000:3.0:1789043002.953634:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242444928 00000100:00100000:3.0:1789043002.953696:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 118 00000100:00100000:3.0:1789043002.953707:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+56:10547:x1875947242444928:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789043002.953728:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789043002.953752:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c0672e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676a8f expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043002.953786:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06735 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043002.953799:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06735 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043002.953810:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06735 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.955221:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c0672e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a8f expref: 58 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.955246:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06735 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a8f expref: 57 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043002.955652:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa06a55d80000) 00010000:00010000:1.0:1789043002.955655:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789043002.955659:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc28200, rc 0) 00000100:00100000:1.0:1789043002.955736:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+57:10547:x1875947242444928:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 2029us (3784us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043002.955744:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 118 00000100:00100000:1.0:1789043002.962095:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043002.963101:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242445184 00000100:00100000:2.0:1789043002.963115:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242445184 00000100:00100000:2.0:1789043002.963221:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 119 00000100:00100000:2.0:1789043002.963232:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+57:10547:x1875947242445184:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789043002.963324:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c0673c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.963345:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c0673c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.963358:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c0673c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789043002.963906:0:6714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1789043002.963918:0:6714:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 345920402489ns, next at 346920400075ns, rc = 0 00000004:00010000:2.0:1789043002.964009:0:6714:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000461d368b reply state 00000000915bd804 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c0673c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043002.964018:0:6714:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789043002.964150:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+59:10547:x1875947242445184:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 Request processed in 918us (2062us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1789043002.964158:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 119 00000100:00100000:1.0:1789043002.973828:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00010000:00010000:2.0:1789043002.974453:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c0673c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.974643:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c0673c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.974671:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c0673c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.974677:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979400 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043002.974682:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c0673c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.974690:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c0673c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.974707:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa06a55d80000) 00010000:00010000:2.0:1789043002.974711:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789043002.974716:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c0673c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043002.974722:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c0673c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043002.975990:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242445312 00000100:00100000:3.0:1789043002.976014:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242445312 00000100:00100000:3.0:1789043002.976110:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 120 00000100:00100000:3.0:1789043002.976121:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f33b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+58:10547:x1875947242445312:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789043002.976146:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789043002.976166:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06743 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676a96 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043002.976220:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06743 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a96 expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043002.976249:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06743 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a96 expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043002.976281:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa06a55d80000) 00010000:00010000:3.0:1789043002.976284:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789043002.976287:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc28400, rc 0) 00000100:00100000:3.0:1789043002.977889:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f33b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+59:10547:x1875947242445312:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 1749us (4050us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043002.977900:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 120 00000100:00100000:1.0:1789043002.988119:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043002.988222:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242445440 00000100:00100000:0.0:1789043002.988231:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242445440 00000100:00100000:0.0:1789043002.988285:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 37 00000100:00100000:0.0:1789043002.988296:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f33aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:2351:x1875947242445440:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789043002.988800:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f33aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+9:2351:x1875947242445440:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 Request processed in 504us (689us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789043002.988809:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 37 00000100:00100000:2.0:1789043002.992022:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043002.992097:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242445696 00000100:00100000:1.0:1789043002.992106:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242445696 00000100:00100000:1.0:1789043002.992161:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 30 00000100:00100000:1.0:1789043002.992184:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a453a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+59:10547:x1875947242445696:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789043002.992404:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a453a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+60:10547:x1875947242445696:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 Request processed in 221us (390us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1789043002.992412:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 30 00000100:00100000:1.0:1789043002.995755:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043002.995835:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242445952 00000100:00100000:2.0:1789043002.995845:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242445952 00000100:00100000:2.0:1789043002.995909:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 121 00000100:00100000:2.0:1789043002.995919:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f33b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+60:10547:x1875947242445952:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789043002.996033:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f33b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+60:10547:x1875947242445952:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 Request processed in 115us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043002.996041:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 121 00000100:00100000:2.0:1789043003.001091:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043003.001183:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242446080 00000100:00100000:0.0:1789043003.001193:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242446080 00000100:00100000:0.0:1789043003.001264:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 122 00000100:00100000:0.0:1789043003.001275:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a453a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+60:10547:x1875947242446080:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789043003.001295:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789043003.001315:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c0674a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676a9d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.001378:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06751 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.001392:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06751 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.001404:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06751 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789043003.001479:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789043003.001499:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06751 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.001570:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c0674a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a9d expref: 62 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.001589:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06751 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a9d expref: 61 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.001597:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa06a55d80000) 00010000:00010000:0.0:1789043003.001600:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789043003.001604:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a40031000, rc 0) 00000100:00100000:0.0:1789043003.001654:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a453a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+61:10547:x1875947242446080:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 380us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043003.001661:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 122 00000100:00080000:2.0:1789043003.003423:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789043003.012708:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043003.012808:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242446208 00000100:00100000:0.0:1789043003.012819:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242446208 00000100:00100000:0.0:1789043003.012889:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 38 00000100:00100000:0.0:1789043003.012900:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42f41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+9:2352:x1875947242446208:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789043003.012919:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789043003.012941:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c359890/0x99260d7389c06758 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676aa4 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789043003.012970:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa2a13b, blocks: 0x1 00010000:00010000:0.0:1789043003.012990:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=345s v=(0 0) 00010000:00010000:0.0:1789043003.013017:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043003.013026:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c359890/0x99260d7389c06758 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aa4 expref: 10 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.013045:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007c359890/0x99260d7389c06758 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aa4 expref: 10 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.013059:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a40031a00, rc 0) 00000100:00100000:0.0:1789043003.013108:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42f41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+10:2352:x1875947242446208:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 209us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043003.013115:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 38 00000100:00080000:2.0:1789043003.013474:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789043003.017242:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043003.017327:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242446464 00000100:00100000:1.0:1789043003.017337:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242446464 00000100:00100000:1.0:1789043003.017401:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 123 00000100:00100000:1.0:1789043003.017413:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f85fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+61:10547:x1875947242446464:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789043003.017557:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f85fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+61:10547:x1875947242446464:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 Request processed in 147us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043003.017565:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 123 00000100:00100000:2.0:1789043003.023320:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043003.023408:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242446592 00000100:00100000:0.0:1789043003.023419:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242446592 00000100:00100000:0.0:1789043003.023485:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 39 00000100:00100000:0.0:1789043003.023495:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a453a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+10:10547:x1875947242446592:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789043003.023546:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789043003.023564:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ddad4c12/0x99260d7389c0675f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676aab expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.023595:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007c359890/0x99260d7389c06758 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aa4 expref: 11 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.023604:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043003.023608:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043003.023613:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ddad4c12/0x99260d7389c0675f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aab expref: 11 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.023661:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007c359890/0x99260d7389c06758 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aa4 expref: 11 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.023676:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007c359890/0x99260d7389c06758 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aa4 expref: 11 pid: 6691 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043003.023691:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6692:1875947267626496:192.168.203.17@tcp:104: 00000100:00100000:0.0:1789043003.023776:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7726c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789043003.028456:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043003.028858:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6692:1875947267626496:192.168.203.17@tcp:104: 00010000:00010000:0.0:1789043003.028904:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ddad4c12/0x99260d7389c0675f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aab expref: 11 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.028926:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a40031c00, rc 0) 00000100:00100000:0.0:1789043003.028990:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a453a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+11:10547:x1875947242446592:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 5496us (5680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043003.029007:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 39 00000100:00100000:1.0:1789043003.029756:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242446720 00000100:00100000:1.0:1789043003.029764:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242446720 00010000:00010000:1.0:1789043003.029802:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007c359890/0x99260d7389c06758 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aa4 expref: 11 pid: 6691 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043003.029841:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 55 00000100:00100000:1.0:1789043003.029852:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f85ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+11:2352:x1875947242446720:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789043003.029866:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789043003.029897:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007c359890/0x99260d7389c06758 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aa4 expref: 11 pid: 6691 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.029911:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007c359890/0x99260d7389c06758 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aa4 expref: 11 pid: 6691 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.029953:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c359890/0x99260d7389c06758 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aa4 expref: 11 pid: 6691 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.029967:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789043003.029971:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789043003.029978:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ddad4c12/0x99260d7389c0675f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aab expref: 10 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.029988:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ddad4c12/0x99260d7389c0675f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aab expref: 10 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.030030:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ddad4c12/0x99260d7389c0675f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aab expref: 10 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043003.030044:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5831:1875947267626624:192.168.203.17@tcp:105: 00000100:00100000:1.0:1789043003.030110:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7a8e5780 going to sleep for 11 seconds 00000100:00100000:1.0:1789043003.035184:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5831:1875947267626624:192.168.203.17@tcp:105: 00010000:00010000:1.0:1789043003.035216:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789043003.035273:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f85ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+10:2352:x1875947242446720:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 5423us (6839us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043003.035283:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 55 00000100:00100000:3.0:1789043003.037103:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043003.037194:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242446848 00000100:00100000:2.0:1789043003.037203:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242446848 00002000:00100000:2.0:1789043003.037246:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffffa06a7f85dc00 x1875947242446848/t0(0) o4->3fb32839-ebfd-4c0f-90e4-f036c86704df@192.168.203.17@tcp:299/0 lens 504/0 e 0 to 0 dl 1789043014 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789043003.037258:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa06a7f85dc00 with x1875947242446848 ext(0->12) 00002000:00010000:2.0:1789043003.037263:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa06a7f85dc00 00000100:00100000:2.0:1789043003.037293:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 2 00000100:00100000:2.0:1789043003.037303:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f85dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+10:2352:x1875947242446848:12345-192.168.203.17@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789043003.037757:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f85dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+12:2352:x1875947242446848:12345-192.168.203.17@tcp:4:lhsmtool_posix.0 Request processed in 454us (659us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789043003.037766:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 2 00002000:00100000:2.0:1789043003.037773:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffffa06a7f85dc00 x1875947242446848/t4294967308(0) o4->3fb32839-ebfd-4c0f-90e4-f036c86704df@192.168.203.17@tcp:299/0 lens 504/448 e 0 to 0 dl 1789043014 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789043003.037782:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa06a7f85dc00 with x1875947242446848 ext(0->12) 00002000:00010000:2.0:1789043003.037786:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa06a7f85dc00 00000100:00100000:2.0:1789043003.043213:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043003.044441:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242446976 00000100:00100000:3.0:1789043003.044466:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242446976 00000100:00100000:3.0:1789043003.044578:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 124 00000100:00100000:3.0:1789043003.044588:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a453a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+61:10547:x1875947242446976:12345-192.168.203.17@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789043003.143742:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967397 is committed 00000001:00080000:0.0:1789043003.143793:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1789043003.143811:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1789043003.143840:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa06a52c9c0c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1789043003.143847:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa06a505dd600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa06a42afc300 00000020:00080000:0.0:1789043003.143851:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa06a505dd300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa06a7a855c00 00000004:00080000:0.0:1789043003.143898:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1789043003.144033:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1789043003.144249:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267626752:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789043003.144339:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043003.144442:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789043003.144452:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267626880:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789043003.144501:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043003.144590:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267626752 00000100:00100000:1.0:1789043003.144600:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267626752 00000100:00100000:1.0:1789043003.144680:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267626880 00000100:00100000:1.0:1789043003.144684:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267626880 00000100:00100000:1.0:1789043003.144710:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789043003.144721:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3313:x1875947267626752:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789043003.144760:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:1.0:1789043003.144796:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ecff716/0x99260d7389c06766 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.144825:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000000504581/0x99260d7389c06528 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a0a expref: 11 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.144836:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1789043003.144842:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789043003.144848:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ecff716/0x99260d7389c06766 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.144884:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000000504581/0x99260d7389c06528 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a0a expref: 11 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.144900:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000000504581/0x99260d7389c06528 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a0a expref: 11 pid: 6691 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043003.144914:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7fa3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6691:1875947267627008:192.168.203.17@tcp:104: 00000100:00100000:1.0:1789043003.145017:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7a8e53c0 going to sleep for 11 seconds 00000100:00080000:1.0:1789043003.145046:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789043003.145065:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789043003.145074:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7fa3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3315:x1875947267626880:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789043003.145266:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789043003.145270:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789043003 00002000:00010000:1.0:1789043003.145273:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789043003.145275:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789043003 -> 1789043003 00002000:00010000:1.0:1789043003.145278:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789043003.145326:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7fa3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3315:x1875947267626880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 254us (825us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789043003.145335:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:1.0:1789043003.145384:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa06a6f1e0e00/2, rc 0, transno 4294967309 00000100:00100000:1.0:1789043003.145391:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267626880:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1789043003.146802:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1789043003.146840:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa06a42ee4c00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1789043003.146846:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa06a7658cf00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa06a42ee43c0 00000020:00080000:0.0:1789043003.146850:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa06a7658c200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa06a52cf9400 00000100:00100000:3.0:1789043003.147289:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789043003.147313:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267627136:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789043003.147394:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043003.147454:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267627136 00000100:00100000:3.0:1789043003.147571:0:8215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267627136 00000100:00100000:3.0:1789043003.147726:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789043003.147739:0:8215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f85f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1875947267627136:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789043003.147771:0:8215:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:3.0:1789043003.147831:0:8215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa2a13a, atime: 0x6aa2a13a, ctime: 0x6aa2a13a, blocks: 0x1 00010000:00010000:3.0:1789043003.147840:0:8215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d88b0774/0x99260d7389c0676d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043003.147860:0:8215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=346s v=(0 0) 00010000:00010000:3.0:1789043003.147865:0:8215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789043003.147873:0:8215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d88b0774/0x99260d7389c0676d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043003.147890:0:8215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d88b0774/0x99260d7389c0676d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043003.147902:0:8215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d88b0774/0x99260d7389c0676d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043003.147911:0:8215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d88b0774/0x99260d7389c0676d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043003.148118:0:8215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:1.0:1789043003.151081:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1789043003.152437:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1789043003.153906:0:8215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f85f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3314:x1875947267627136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6161us (6501us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789043003.153922:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:3.0:1789043003.153986:0:11175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789043003.154012:0:11175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d88b0774/0x99260d7389c0676d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043003.154028:0:11175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc28800 already unused, calling callback (ffffffffc1470760) 00010000:00010000:3.0:1789043003.154046:0:11175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d88b0774/0x99260d7389c0676d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043003.154061:0:11175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d88b0774/0x99260d7389c0676d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043003.154087:0:11175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d88b0774/0x99260d7389c0676d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043003.154097:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d88b0774/0x99260d7389c0676d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043003.154126:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043003.154128:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043003.154130:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789043003.154145:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1789043003.156653:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa06a7f85ed80/2, rc 0, transno 4294967304 00000100:00100000:1.0:1789043003.156674:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267627136:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789043003.158827:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7fa3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6691:1875947267627008:192.168.203.17@tcp:104: 00010000:00010000:1.0:1789043003.158876:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005ecff716/0x99260d7389c06766 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043003.159873:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043003.160373:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242447104 00000100:00100000:1.0:1789043003.160385:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242447104 00010000:00010000:1.0:1789043003.160439:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000000504581/0x99260d7389c06528 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a0a expref: 12 pid: 6691 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043003.160556:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 56 00000100:00100000:1.0:1789043003.160569:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a453a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+12:2352:x1875947242447104:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789043003.160589:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789043003.160597:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000000504581/0x99260d7389c06528 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a0a expref: 12 pid: 6691 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.160613:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000000504581/0x99260d7389c06528 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a0a expref: 12 pid: 6691 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.160830:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000504581/0x99260d7389c06528 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a0a expref: 12 pid: 6691 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.160852:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789043003.160857:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789043003.160865:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005ecff716/0x99260d7389c06766 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.160877:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ecff716/0x99260d7389c06766 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.160920:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789043003.161025:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005ecff716/0x99260d7389c06766 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043003.161035:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ecff716/0x99260d7389c06766 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043003.161046:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ecff716/0x99260d7389c06766 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043003.161063:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ecff716/0x99260d7389c06766 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043003.161086:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789043003.162108:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a453a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+11:2352:x1875947242447104:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 1535us (2236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043003.162123:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 56 00010000:00010000:3.0:1789043003.162354:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789043003.162365:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ecff716/0x99260d7389c06766 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043003.162378:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687000 already unused, calling callback (ffffffffc1470760) 00010000:00010000:3.0:1789043003.162384:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ecff716/0x99260d7389c06766 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043003.162396:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ecff716/0x99260d7389c06766 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043003.162418:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ecff716/0x99260d7389c06766 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043003.162433:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ecff716/0x99260d7389c06766 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043003.162461:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043003.162473:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043003.162475:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789043003.162831:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3313:x1875947267626752:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18109us (18489us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789043003.162842:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:2.0:1789043003.162904:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa06a6f1e1f80/2, rc 0, transno 4294967310 00000100:00100000:2.0:1789043003.162912:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267626752:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789043003.164144:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a453a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+15:10547:x1875947242446976:12345-192.168.203.17@tcp:44:lhsmtool_posix.0 Request processed in 119549us (120932us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043003.164165:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 124 00000100:00100000:2.0:1789043003.172854:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043003.173074:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242447232 00000100:00100000:3.0:1789043003.173090:0:8215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242447232 00000100:00100000:3.0:1789043003.173167:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 43 00000100:00100000:3.0:1789043003.173178:0:8215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a453a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+11:2351:x1875947242447232:12345-192.168.203.17@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1789043003.276715:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:1.0:1789043003.276739:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:1.0:1789043003.276747:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:1.0:1789043003.276759:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1789043003.276764:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:0.0:1789043003.277119:0:8215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a453a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2351:x1875947242447232:12345-192.168.203.17@tcp:16:lhsmtool_posix.0 Request processed in 103932us (104278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043003.277133:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 43 00000100:00100000:2.0:1789043003.290510:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043003.290870:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242447488 00000100:00100000:1.0:1789043003.290885:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242447488 00000100:00100000:1.0:1789043003.290973:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 125 00000100:00100000:1.0:1789043003.290986:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79c7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+15:10547:x1875947242447488:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789043003.291083:0:11703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789043003.291328:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06751 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a9d expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.291355:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa06a55d80000) 00010000:00010000:1.0:1789043003.291362:0:11703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789043003.291404:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06774 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.291421:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06774 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.291433:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06774 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789043003.292745:0:11703:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001723e26f reply state 0000000091c5015e transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06774 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043003.292766:0:11703:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789043003.292979:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79c7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+16:10547:x1875947242447488:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 Request processed in 1990us (2480us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1789043003.293397:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 125 00000100:00100000:2.0:1789043003.298394:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043003.298475:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242447616 00000100:00100000:3.0:1789043003.298488:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242447616 00000100:00100000:3.0:1789043003.298596:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 44 00000100:00100000:3.0:1789043003.298607:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79c79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2351:x1875947242447616:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789043003.298907:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1789043003.298912:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789043003 -> 1789043002 00002000:00010000:3.0:1789043003.298915:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789043002 00002000:00010000:3.0:1789043003.298917:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789043003 -> 1789043002 00002000:00010000:3.0:1789043003.298919:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789043003.298987:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79c79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2351:x1875947242447616:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 Request processed in 381us (605us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789043003.299016:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 44 00010000:00010000:1.0:1789043003.299914:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06774 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.299929:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06774 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.299938:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06774 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.299945:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043003.299951:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06774 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.299960:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06774 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.299977:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa06a55d80000) 00010000:00010000:1.0:1789043003.299981:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043003.299987:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06774 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.300006:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06774 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043003.302278:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043003.302433:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242447872 00000100:00100000:0.0:1789043003.302449:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242447872 00000100:00100000:0.0:1789043003.302579:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 126 00000100:00100000:0.0:1789043003.302601:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79c78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+15:10547:x1875947242447872:12345-192.168.203.17@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789043003.302694:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c0677b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.302716:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06735 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a8f expref: 15 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.302727:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c0677b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.302773:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06735 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a8f expref: 15 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.302789:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06735 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a8f expref: 15 pid: 11703 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043003.302826:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875947267627264:192.168.203.17@tcp:104: 00000100:00100000:0.0:1789043003.302934:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7726cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789043003.307649:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043003.309073:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242448000 00000100:00100000:1.0:1789043003.309100:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242448000 00010000:00010000:1.0:1789043003.309186:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06735 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a8f expref: 16 pid: 11703 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043003.309247:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 57 00000100:00100000:1.0:1789043003.309279:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+16:2351:x1875947242448000:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789043003.309298:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789043003.309305:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06735 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a8f expref: 16 pid: 11703 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.309321:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06735 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a8f expref: 16 pid: 11703 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.309347:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa06a55d80000) 00010000:00010000:1.0:1789043003.309354:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c0677b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.309364:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c0677b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.309373:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c0677b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.309398:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789043003.309474:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+16:2351:x1875947242448000:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 198us (1839us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043003.309483:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 57 00010000:00010000:2.0:1789043003.310660:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06735 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a8f expref: 15 pid: 11703 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043003.310690:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875947267627264:192.168.203.17@tcp:104: 00010000:00010000:2.0:1789043003.310719:0:6714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c0677b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043003.310730:0:6714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c0677b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043003.310736:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c0677b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043003.310796:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c0677b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043003.310805:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c0677b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043003.310813:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c0677b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043003.310819:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a40031a00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043003.310824:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c0677b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043003.310834:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c0677b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043003.310848:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa06a55d80000) 00010000:00010000:2.0:1789043003.310852:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789043003.310857:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c0677b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043003.310864:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c0677b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043003.311021:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79c78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+14:10547:x1875947242447872:12345-192.168.203.17@tcp:55:lhsmtool_posix.0 Request processed in 8421us (8755us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789043003.311033:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 126 00000100:00100000:0.0:1789043003.316683:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043003.316846:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242448128 00000100:00100000:3.0:1789043003.316860:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242448128 00000100:00100000:3.0:1789043003.316934:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 45 00000100:00100000:3.0:1789043003.316973:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2352:x1875947242448128:12345-192.168.203.17@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789043003.317036:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000083f7dbf9/0x99260d7389c06782 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043003.317062:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ddad4c12/0x99260d7389c0675f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aab expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043003.317073:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789043003.317077:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789043003.317083:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083f7dbf9/0x99260d7389c06782 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043003.317129:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ddad4c12/0x99260d7389c0675f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aab expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043003.317147:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ddad4c12/0x99260d7389c0675f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aab expref: 7 pid: 6692 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043003.317166:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f85c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6690:1875947267627392:192.168.203.17@tcp:104: 00000100:00100000:3.0:1789043003.317268:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a454a69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789043003.321939:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f85c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6690:1875947267627392:192.168.203.17@tcp:104: 00010000:00010000:0.0:1789043003.321988:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000083f7dbf9/0x99260d7389c06782 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043003.329450:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043003.329651:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242448256 00000100:00100000:1.0:1789043003.329664:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242448256 00010000:00010000:1.0:1789043003.329722:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ddad4c12/0x99260d7389c0675f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aab expref: 8 pid: 6692 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043003.332235:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 58 00000100:00100000:1.0:1789043003.332272:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:2352:x1875947242448256:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789043003.332321:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789043003.332362:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ddad4c12/0x99260d7389c0675f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aab expref: 8 pid: 6692 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.332386:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ddad4c12/0x99260d7389c0675f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aab expref: 8 pid: 6692 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.332415:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ddad4c12/0x99260d7389c0675f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aab expref: 8 pid: 6692 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.332436:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789043003.332441:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789043003.332448:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000083f7dbf9/0x99260d7389c06782 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.332458:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083f7dbf9/0x99260d7389c06782 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.332634:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789043003.332725:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2352:x1875947242448256:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 473us (3288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043003.332735:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 58 00010000:00010000:1.0:1789043003.332928:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000083f7dbf9/0x99260d7389c06782 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.332940:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083f7dbf9/0x99260d7389c06782 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.332984:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000083f7dbf9/0x99260d7389c06782 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.333016:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083f7dbf9/0x99260d7389c06782 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.333026:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083f7dbf9/0x99260d7389c06782 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.333034:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc28a00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:1.0:1789043003.333040:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083f7dbf9/0x99260d7389c06782 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.333050:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083f7dbf9/0x99260d7389c06782 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.333065:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083f7dbf9/0x99260d7389c06782 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.333072:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083f7dbf9/0x99260d7389c06782 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043003.333132:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2352:x1875947242448128:12345-192.168.203.17@tcp:1:lhsmtool_posix.0 Request processed in 16161us (16463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043003.333142:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 45 00000100:00100000:3.0:1789043003.340196:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043003.340652:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242448512 00000100:00100000:0.0:1789043003.340664:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242448512 00000100:00100000:0.0:1789043003.340783:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 127 00000100:00100000:0.0:1789043003.340796:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f85e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+14:10547:x1875947242448512:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789043003.340904:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06789 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.340927:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06789 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.340943:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06789 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.342449:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06790 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.342479:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06743 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a96 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.342488:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06790 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.342564:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06743 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a96 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.342584:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06743 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a96 expref: 15 pid: 5845 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043003.342600:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875947267627520:192.168.203.17@tcp:104: 00000100:00100000:0.0:1789043003.342711:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7726cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789043003.346077:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875947267627520:192.168.203.17@tcp:104: 00010000:00010000:0.0:1789043003.346244:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06790 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043003.347130:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043003.347395:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242448640 00000100:00100000:1.0:1789043003.347406:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242448640 00010000:00010000:1.0:1789043003.347459:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06743 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a96 expref: 16 pid: 5845 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043003.347625:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 59 00000100:00100000:1.0:1789043003.347637:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f85c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+16:2352:x1875947242448640:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789043003.347655:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789043003.347663:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06743 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a96 expref: 16 pid: 5845 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.347677:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06743 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a96 expref: 16 pid: 5845 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.347704:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06743 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a96 expref: 16 pid: 5845 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.347725:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa06a55d80000) 00010000:00010000:1.0:1789043003.347731:0:6705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06790 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.347967:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06790 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.347977:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06790 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043003.348063:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789043003.348150:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f85c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+15:2352:x1875947242448640:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 514us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043003.348166:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 59 00010000:00010000:0.0:1789043003.352881:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06790 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.352903:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06790 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789043003.353900:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1789043003.354141:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1789043003.355346:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1789043003.355903:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1875947267627648:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789043003.356012:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043003.356126:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7726c480 going to sleep for 11 seconds 00000100:00100000:3.0:1789043003.356823:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267627648 00000100:00100000:3.0:1789043003.356837:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267627648 00000100:00100000:3.0:1789043003.357004:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789043003.357018:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6fc26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1875947267627648:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789043003.357217:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6fc26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1875947267627648:12345-0@lo:1000:mdt00_001.0 Request processed in 150us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043003.357228:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789043003.357243:0:5846:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1789043003.357251:0:5846:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:0.0:1789043003.357277:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa06a6f1e0e00, transno 4294967309 00000004:00080000:0.0:1789043003.357328:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa06a6f1e1f80, transno 4294967310 00000100:00100000:0.0:1789043003.359803:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1875947267627648:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1789043003.362300:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1789043003.362424:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6fc24a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1875947267627776:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789043003.362619:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043003.362715:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7726cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789043003.362820:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267627776 00000100:00100000:1.0:1789043003.362836:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267627776 00000100:00100000:1.0:1789043003.362956:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789043003.362968:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1875947267627776:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789043003.363249:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1875947267627776:12345-0@lo:1000:mdt00_001.0 Request processed in 284us (630us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1789043003.363258:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789043003.363336:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6fc24a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1875947267627776:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1789043003.363379:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06790 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.363391:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06790 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.363400:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06790 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.363406:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a40031c00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789043003.363412:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06790 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.363421:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06790 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.363448:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa06a55d80000) 00010000:00010000:0.0:1789043003.363452:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789043003.363459:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06790 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.363466:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c06790 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.363551:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c066d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.363558:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c066d3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.363563:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c066d3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.363568:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a40031600 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789043003.363571:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c066d3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.363578:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c066d3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.363586:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa06a457d3600) 00010000:00010000:0.0:1789043003.363588:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789043003.363596:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c066da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a7a expref: 18 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.363608:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c066da lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a7a expref: 18 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.363625:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c066da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a7a expref: 18 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.363658:0:5846:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c066da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a7a expref: 18 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043003.363671:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52dffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875947267627904:192.168.203.17@tcp:105: 00000100:00100000:0.0:1789043003.363757:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7726cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789043003.368554:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043003.368607:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242448768 00000100:00100000:3.0:1789043003.368621:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242448768 00000100:00100000:3.0:1789043003.368701:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 31 00000100:00100000:3.0:1789043003.368714:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+19:10546:x1875947242448768:12345-192.168.203.17@tcp:49:lfs.0 00000100:00100000:0.0:1789043003.368817:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52dffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875947267627904:192.168.203.17@tcp:105: 00010000:00010000:0.0:1789043003.368850:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c066d3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.368863:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c066d3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043003.368871:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+19:10546:x1875947242448768:12345-192.168.203.17@tcp:49:lfs.0 Request processed in 160us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043003.368877:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 31 00010000:00010000:0.0:1789043003.368904:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06797 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.368922:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06797 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.368937:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06797 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.368947:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06797 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.368954:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06797 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.368979:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06797 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.368986:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a40031a00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789043003.368991:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06797 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.369009:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06797 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.369023:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa06a457d3600) 00010000:00010000:0.0:1789043003.369027:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789043003.369031:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06797 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.369038:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06797 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.369050:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06789 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.369057:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06789 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.369062:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06789 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.369068:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a40031000 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789043003.369071:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06789 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.369091:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06789 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.370280:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa06a457d3600) 00010000:00010000:0.0:1789043003.370284:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789043003.370290:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06789 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.370298:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06789 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043003.371410:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f85e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+18:10547:x1875947242448512:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 Request processed in 30606us (31220us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1789043003.371425:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 127 00000020:00080000:0.0:1789043003.371432:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789043003.373053:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789043003.373072:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789043003.374764:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1789043003.374781:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789043003.378264:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043003.378326:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043003.378508:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242449024 00000100:00100000:3.0:1789043003.378568:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242449024 00000100:00100000:3.0:1789043003.378634:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 32 00000100:00100000:3.0:1789043003.378647:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a50c20050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+18:10547:x1875947242449024:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789043003.379548:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789043003.379686:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1789043003.379746:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c0679e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043003.379766:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c0679e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043003.379781:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c0679e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043003.379799:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c0679e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043003.379806:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c0679e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043003.379812:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c0679e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043003.379837:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789043003.379957:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a50c20050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+20:10547:x1875947242449024:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 Request processed in 1307us (1702us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1789043003.379966:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 32 00000020:00080000:3.0:1789043003.379972:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789043003.380062:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789043003.380070:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c0679e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043003.380077:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc28800 already unused, calling callback (ffffffffc1470760) 00010000:00010000:3.0:1789043003.380082:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c0679e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043003.380091:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c0679e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043003.380105:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa06a55d80700) 00010000:00010000:3.0:1789043003.380109:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789043003.380114:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c0679e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043003.380132:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c0679e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043003.380151:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043003.380153:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043003.380155:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789043003.381913:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242449280 00000100:00100000:1.0:1789043003.381933:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242449280 00000100:00100000:1.0:1789043003.382058:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 128 00000100:00100000:1.0:1789043003.382070:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+20:10546:x1875947242449280:12345-192.168.203.17@tcp:58:lfs.0 00000040:00080000:1.0:1789043003.382416:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1789043003.382886:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+20:10546:x1875947242449280:12345-192.168.203.17@tcp:58:lfs.0 Request processed in 815us (4556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043003.382896:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 128 00000100:00100000:2.0:1789043003.420593:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043003.420712:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242449408 00000100:00100000:0.0:1789043003.420728:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242449408 00000100:00100000:0.0:1789043003.420813:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 129 00000100:00100000:0.0:1789043003.420825:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+20:10549:x1875947242449408:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:0.0:1789043003.420857:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789043003.420886:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c067a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676ab2 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.420969:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c067ac lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.420988:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c067ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.421035:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c067ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.421054:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c067b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.421061:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c067b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.421068:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c067b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.421356:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c067ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.421371:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c066c5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a73 expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.421381:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c067ba lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.421424:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c066c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a73 expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.421439:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c066c5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a73 expref: 21 pid: 5846 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043003.421456:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52dffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875947267628032:192.168.203.17@tcp:104: 00000100:00100000:0.0:1789043003.421614:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7726ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789043003.427326:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043003.427567:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242449664 00000100:00100000:3.0:1789043003.427581:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242449664 00000100:00100000:3.0:1789043003.427654:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 33 00000100:00100000:3.0:1789043003.427666:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+22:5592:x1875947242449664:12345-192.168.203.17@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789043003.428001:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+23:5592:x1875947242449664:12345-192.168.203.17@tcp:35:ldlm_bl.0 Request processed in 327us (677us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1789043003.428010:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 33 00000100:00100000:0.0:1789043003.428758:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52dffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875947267628032:192.168.203.17@tcp:104: 00010000:00010000:0.0:1789043003.428791:0:6714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c067ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043003.440441:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043003.440619:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242449792 00000100:00100000:0.0:1789043003.440633:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242449792 00010000:00010000:0.0:1789043003.440693:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c066c5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a73 expref: 23 pid: 5846 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043003.440736:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 60 00000100:00100000:0.0:1789043003.440748:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46f8a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+23:2352:x1875947242449792:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789043003.440767:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789043003.440775:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c066c5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a73 expref: 23 pid: 5846 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.440790:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c066c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a73 expref: 23 pid: 5846 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.440818:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c066c5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a73 expref: 23 pid: 5846 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.440840:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa06a457d3600) 00010000:00010000:0.0:1789043003.440846:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c067ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.440858:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c067ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.440866:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c067ba lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043003.440925:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789043003.441013:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46f8a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+22:2352:x1875947242449792:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 266us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043003.441022:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 60 00010000:00010000:2.0:1789043003.441090:0:6714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c067ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043003.441100:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c067ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789043003.441222:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789043003.441228:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789043003.441255:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c067ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043003.441271:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c067ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043003.441282:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c067ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043003.441289:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c067ac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043003.441296:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c067ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043003.441303:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a40031a00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043003.441308:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c067ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043003.441317:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c067ac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043003.441328:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa06a44e19c00) 00010000:00010000:2.0:1789043003.441341:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043003.441346:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c067ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043003.441353:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c067ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043003.441369:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c067b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043003.441375:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c067b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043003.441381:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c067b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043003.441386:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a40031600 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043003.441388:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c067b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043003.441395:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c067b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043003.441403:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa06a55221a00) 00010000:00010000:2.0:1789043003.441405:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043003.441408:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c067b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043003.441413:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c067b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043003.443260:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c067a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ab2 expref: 22 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043003.443324:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c067ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ab2 expref: 21 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043003.443334:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa06a457d3600) 00010000:00010000:2.0:1789043003.443337:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789043003.443341:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a40031c00, rc 0) 00000100:00100000:2.0:1789043003.443890:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+21:10549:x1875947242449408:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 23061us (23306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043003.443902:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 129 00000100:00100000:3.0:1789043003.639108:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52dffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267628160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789043003.639224:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043003.639343:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267628160 00000100:00100000:0.0:1789043003.639353:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267628160 00000100:00100000:0.0:1789043003.639417:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789043003.639430:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f85ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875947267628160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789043003.639459:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789043003.646048:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f85ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875947267628160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6604us (6806us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043003.646066:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789043003.646093:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52dffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267628160:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789043003.763280:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789043004.347980:0:12109:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789043004.349567:0:12109:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789043004.349839:0:12109:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789043004.349846:0:12109:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1789043004.402981:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789043004.403001:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789043004.403049:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789043004.403056:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789043004.403178:0:11689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52dffb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1875947267628288:192.168.203.17@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789043004.403268:0:11689:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7726c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789043004.409710:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043004.409812:0:11689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52dffb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1875947267628288:192.168.203.17@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789043004.411127:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242449920 00000100:00100000:2.0:1789043004.411137:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242449920 00000100:00100000:2.0:1789043004.411196:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 130 00000100:00100000:2.0:1789043004.411207:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f85c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+21:10561:x1875947242449920:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789043004.411240:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789043004.411481:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f85c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+21:10561:x1875947242449920:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 Request processed in 275us (1779us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043004.411489:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 130 00000100:00100000:1.0:1789043004.419033:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043004.419201:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242450176 00000100:00100000:2.0:1789043004.419211:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242450176 00000100:00100000:2.0:1789043004.419279:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 131 00000100:00100000:2.0:1789043004.419290:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7fa3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+21:10561:x1875947242450176:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789043004.419312:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043004.419337:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c067c1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676ab9 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043004.419461:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c067c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043004.419478:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c067c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043004.419492:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c067c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789043004.419504:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789043004.419666:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c067c1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ab9 expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043004.419686:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c067c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ab9 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043004.419695:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa06a457d3600) 00010000:00010000:2.0:1789043004.419698:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789043004.419702:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50979200, rc 0) 00000100:00100000:2.0:1789043004.419766:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7fa3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+23:10561:x1875947242450176:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 478us (743us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1789043004.419773:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 131 00000100:00100000:0.0:1789043004.425032:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043004.425113:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242450432 00000100:00100000:2.0:1789043004.425124:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242450432 00000100:00100000:2.0:1789043004.425187:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 132 00000100:00100000:2.0:1789043004.425198:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52dffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+23:10561:x1875947242450432:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789043004.425293:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c067d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043004.425318:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c067d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043004.425330:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c067d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043004.425540:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c067d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043004.425550:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c067d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043004.425557:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c067d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043004.425564:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50978000 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043004.425568:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c067d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043004.425576:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c067d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043004.425586:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa06a457d3600) 00010000:00010000:2.0:1789043004.425589:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789043004.425594:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c067d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043004.425600:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c067d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043004.425746:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52dffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+24:10561:x1875947242450432:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 Request processed in 544us (718us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1789043004.425759:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 132 00000040:00080000:3.0:1789043004.427706:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789043004.427714:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789043004.428579:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789043004.428592:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789043004.430743:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043004.430835:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043004.430889:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242450560 00000100:00100000:2.0:1789043004.430899:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242450560 00000100:00100000:2.0:1789043004.430967:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 9 00000100:00100000:2.0:1789043004.430979:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7fa3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+24:2352:x1875947242450560:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789043004.431003:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789043004.431028:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c067c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ab9 expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043004.431044:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa06a457d3600) 00010000:00010000:2.0:1789043004.431049:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789043004.431103:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7fa3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+23:2352:x1875947242450560:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 127us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043004.431111:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 9 00000100:00100000:0.0:1789043004.431246:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242450816 00000100:00100000:0.0:1789043004.431252:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242450816 00000100:00100000:0.0:1789043004.431355:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 34 00000100:00100000:0.0:1789043004.431363:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7fa3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+23:10561:x1875947242450816:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789043004.431571:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7fa3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+24:10561:x1875947242450816:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 Request processed in 209us (734us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1789043004.431588:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 34 00010000:00010000:3.0:1789043004.788358:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043005.810830:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789043006.339030:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1789043006.339065:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000040:00080000:2.0:1789043006.430071:0:12160:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789043006.430084:0:12160:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789043006.430133:0:12160:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789043006.430141:0:12160:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789043006.706896:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267628544:0@lo:400:kworker.0 00000100:00100000:3.0:1789043006.707022:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043006.707082:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a453a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267629056:0@lo:400:kworker.0 00000100:00100000:0.0:1789043006.707299:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267628800:0@lo:400:kworker.0 00000100:00100000:0.0:1789043006.707340:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043006.707382:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789043006.707388:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267628416:0@lo:400:kworker.0 00000100:00100000:0.0:1789043006.707422:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043006.707446:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875947267628928:0@lo:400:kworker.0 00000100:00100000:0.0:1789043006.707468:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043006.707507:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267628416 00000100:00100000:0.0:1789043006.707545:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267628416 00000100:00100000:0.0:1789043006.707614:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1789043006.707624:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3312:x1875947267628416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789043006.707684:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3312:x1875947267628416:12345-0@lo:400:kworker.0 Request processed in 61us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043006.707692:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1789043006.707744:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267628416:0@lo:400:kworker.0 00000100:00100000:3.0:1789043006.707940:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043006.708043:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789043006.708050:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267628672:0@lo:400:kworker.0 00000100:00100000:3.0:1789043006.708079:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043006.708190:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267628800 00000100:00100000:3.0:1789043006.708197:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267628800 00000100:00100000:3.0:1789043006.708241:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267629056 00000100:00100000:3.0:1789043006.708244:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267629056 00000100:00100000:3.0:1789043006.708269:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789043006.708276:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942106d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267628800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789043006.708322:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942106d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267628800:12345-0@lo:400:kworker.0 Request processed in 47us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043006.708329:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789043006.708343:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789043006.708349:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1875947267629056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789043006.708380:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1875947267629056:12345-0@lo:400:kworker.0 Request processed in 31us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043006.708386:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1789043006.708403:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789043006.708407:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789043006.708435:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1789043006.708441:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1789043006.708462:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa06a7f85ed80, transno 4294967304 00000100:00100000:3.0:1789043006.708473:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267628800:0@lo:400:kworker.0 00000100:00100000:2.0:1789043006.708716:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267628544 00000100:00100000:2.0:1789043006.708722:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267628544 00000100:00100000:2.0:1789043006.708756:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267628928 00000100:00100000:2.0:1789043006.708759:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267628928 00000100:00100000:2.0:1789043006.708781:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267628672 00000100:00100000:2.0:1789043006.708784:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267628672 00000100:00100000:2.0:1789043006.708799:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789043006.708805:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a453a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267628544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789043006.708847:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a453a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267628544:12345-0@lo:400:kworker.0 Request processed in 42us (1826us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043006.708868:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789043006.708895:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789043006.708902:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942106680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875947267628928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789043006.708933:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789043006.708937:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942106680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875947267628928:12345-0@lo:400:kworker.0 Request processed in 37us (1469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043006.708943:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789043006.708948:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5097f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267628672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789043006.708992:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5097f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267628672:12345-0@lo:400:kworker.0 Request processed in 52us (912us total) trans 0 rc 0/0 00000100:00080000:2.0:1789043006.708994:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789043006.709008:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789043006.709015:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875947267628928:0@lo:400:kworker.0 00000100:00100000:2.0:1789043006.709063:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267628672:0@lo:400:kworker.0 00000100:00100000:2.0:1789043006.709075:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267628544:0@lo:400:kworker.0 00000100:00100000:2.0:1789043006.709086:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a453a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267629056:0@lo:400:kworker.0 00000100:00100000:3.0:1789043006.718437:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043006.719536:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242451072 00000100:00100000:2.0:1789043006.719551:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242451072 00000100:00100000:2.0:1789043006.720127:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 133 00000100:00100000:2.0:1789043006.720140:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5097e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+24:10582:x1875947242451072:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:2.0:1789043006.720172:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043006.720212:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c067dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676ac0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043006.720342:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c067e4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043006.720360:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c067e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043006.720395:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c067e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789043006.720411:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000100:00080000:3.0:1789043006.720708:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789043006.723174:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c067dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ac0 expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043006.723211:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c067e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ac0 expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043006.723220:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa06a457d3600) 00010000:00010000:2.0:1789043006.723224:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789043006.723229:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50979e00, rc 0) 00000100:00100000:2.0:1789043006.723333:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5097e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+26:10582:x1875947242451072:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 3194us (4908us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1789043006.723343:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 133 00000100:00100000:2.0:1789043006.733346:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043006.733433:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242451200 00000100:00100000:1.0:1789043006.733448:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242451200 00000100:00100000:1.0:1789043006.733543:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 134 00000100:00100000:1.0:1789043006.733557:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+26:10582:x1875947242451200:12345-192.168.203.17@tcp:54:lfs.0 00010000:00010000:1.0:1789043006.733650:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c067f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043006.733674:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c067f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043006.733689:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c067f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043006.733733:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c067f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043006.733742:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c067f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043006.733750:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c067f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043006.733756:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043006.733761:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c067f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043006.733769:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c067f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043006.733783:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa06a457d3600) 00010000:00010000:1.0:1789043006.733802:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789043006.733809:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c067f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043006.733816:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c067f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043006.733908:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+26:10582:x1875947242451200:12345-192.168.203.17@tcp:54:lfs.0 Request processed in 353us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043006.733916:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 134 00010000:00010000:3.0:1789043006.834631:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789043006.883710:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043006.883861:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242451328 00000100:00100000:3.0:1789043006.883875:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242451328 00000100:00100000:3.0:1789043006.883985:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 46 00000100:00100000:3.0:1789043006.883997:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2349:x1875947242451328:12345-192.168.203.17@tcp:101:cat.0 00010000:00010000:3.0:1789043006.884020:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789043006.884047:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005527b901/0x99260d7389c067f9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676ac7 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789043006.884080:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa2a13a, atime: 0x6aa2a13a, ctime: 0x6aa2a13a, blocks: 0xb 00010000:00010000:3.0:1789043006.884448:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=349s v=(0 0) 00010000:00010000:3.0:1789043006.884457:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789043006.884469:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005527b901/0x99260d7389c067f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ac7 expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043006.884494:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005527b901/0x99260d7389c067f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ac7 expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043006.884565:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc29c00, rc 0) 00000100:00100000:3.0:1789043006.884641:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2349:x1875947242451328:12345-192.168.203.17@tcp:101:cat.0 Request processed in 646us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043006.884650:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 46 00000100:00080000:2.0:1789043006.886794:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789043006.892785:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043006.892947:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242451456 00000100:00100000:1.0:1789043006.892957:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242451456 00002000:00100000:1.0:1789043006.893024:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffffa06a5097ed80 x1875947242451456/t0(0) o3->3fb32839-ebfd-4c0f-90e4-f036c86704df@192.168.203.17@tcp:302/0 lens 488/0 e 0 to 0 dl 1789043017 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789043006.893034:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa06a5097ed80 with x1875947242451456 ext(0->4095) 00002000:00010000:1.0:1789043006.893040:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa06a5097ed80 00000100:00100000:1.0:1789043006.893070:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 3 00000100:00100000:1.0:1789043006.893080:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5097ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2352:x1875947242451456:12345-192.168.203.17@tcp:3:cat.0 00000100:00100000:1.0:1789043006.893341:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5097ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2352:x1875947242451456:12345-192.168.203.17@tcp:3:cat.0 Request processed in 262us (567us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789043006.893348:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 3 00002000:00100000:1.0:1789043006.893355:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffffa06a5097ed80 x1875947242451456/t0(0) o3->3fb32839-ebfd-4c0f-90e4-f036c86704df@192.168.203.17@tcp:302/0 lens 488/4536 e 0 to 0 dl 1789043017 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789043006.893363:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa06a5097ed80 with x1875947242451456 ext(0->4095) 00002000:00010000:1.0:1789043006.893366:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa06a5097ed80 00000100:00100000:2.0:1789043007.218887:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789043007.218912:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267629184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789043007.218991:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043007.219110:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267629184 00000100:00100000:1.0:1789043007.219119:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267629184 00000100:00100000:1.0:1789043007.219191:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789043007.219200:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875947267629184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789043007.219235:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789043007.219291:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875947267629184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043007.219298:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789043007.219390:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267629184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789043007.699300:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043007.699337:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043007.699364:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043007.699387:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043007.699412:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043007.699682:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242452096 00000100:00100000:1.0:1789043007.699692:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242452096 00000100:00100000:1.0:1789043007.699757:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242451712 00000100:00100000:1.0:1789043007.699760:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242451712 00000100:00100000:1.0:1789043007.699784:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 146 00000100:00100000:1.0:1789043007.699794:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2351:x1875947242452096:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1789043007.699868:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2351:x1875947242452096:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 75us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043007.699875:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 146 00000100:00100000:1.0:1789043007.699893:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 147 00000100:00100000:1.0:1789043007.699900:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+26:2351:x1875947242451712:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1789043007.699925:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+26:2351:x1875947242451712:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 27us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043007.699932:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 147 00000100:00100000:1.0:1789043007.699954:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242451840 00000100:00100000:1.0:1789043007.699979:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242451840 00000100:00100000:1.0:1789043007.700011:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242451968 00000100:00100000:1.0:1789043007.700013:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242451968 00000100:00100000:1.0:1789043007.700032:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 82 00000100:00100000:1.0:1789043007.700038:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2351:x1875947242451840:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1789043007.700065:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2351:x1875947242451840:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 27us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043007.700073:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 82 00000100:00100000:1.0:1789043007.700084:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 83 00000100:00100000:1.0:1789043007.700091:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2351:x1875947242451968:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1789043007.700118:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2351:x1875947242451968:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 28us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043007.700124:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 83 00000100:00080000:1.0:1789043007.700151:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789043007.700155:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789043007.700849:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242451584 00000100:00100000:3.0:1789043007.700855:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242451584 00000100:00100000:3.0:1789043007.700892:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 292 00000100:00100000:3.0:1789043007.700909:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2351:x1875947242451584:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1789043007.700943:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2351:x1875947242451584:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 36us (1654us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043007.700950:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 292 00010000:00010000:0.0:1789043007.861814:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789043008.394679:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:2.0:1789043008.394712:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa06a7726c480 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1789043008.394719:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa06a6f022000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa06a7726c180 00000020:00080000:2.0:1789043008.394737:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa06a6f022300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa06a6f32bc00 00000020:00080000:2.0:1789043008.394907:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:2.0:1789043008.394942:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1789043008.394995:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1789043008.395254:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:1.0:1789043008.397575:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:1.0:1789043008.397600:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000100:00100000:3.0:1789043008.755719:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789043008.755742:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267629312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789043008.755823:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043008.755995:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267629312 00000100:00100000:1.0:1789043008.756004:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267629312 00000100:00100000:1.0:1789043008.756059:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789043008.756073:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5097d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267629312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789043008.756105:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789043008.756150:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5097d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267629312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043008.756157:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789043008.756197:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267629312:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789043008.756270:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789043008.887303:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789043009.587991:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789043009.588005:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789043009.588054:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789043009.588062:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789043009.917222:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043010.930791:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789043011.828920:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875947267629696:0@lo:400:kworker.0 00000100:00100000:3.0:1789043011.829004:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043011.829058:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789043011.829064:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a5289c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875947267629568:0@lo:400:kworker.0 00000100:00100000:3.0:1789043011.829084:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043011.829099:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267630080:0@lo:400:kworker.0 00000100:00100000:3.0:1789043011.829136:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043011.829178:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267629696 00000100:00100000:3.0:1789043011.829185:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267629696 00000100:00100000:3.0:1789043011.829233:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267629568 00000100:00100000:3.0:1789043011.829235:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267629568 00000100:00100000:3.0:1789043011.829267:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789043011.829277:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875947267629696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789043011.829335:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875947267629696:12345-0@lo:400:kworker.0 Request processed in 59us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043011.829341:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789043011.829365:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789043011.829371:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875947267629568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789043011.829399:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875947267629568:12345-0@lo:400:kworker.0 Request processed in 28us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043011.829712:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:3.0:1789043011.829741:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789043011.830069:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a5289c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875947267629568:0@lo:400:kworker.0 00000100:00100000:3.0:1789043011.830082:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875947267629696:0@lo:400:kworker.0 00000100:00100000:1.0:1789043011.830183:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267629440:0@lo:400:kworker.0 00000100:00100000:1.0:1789043011.830224:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043011.830260:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875947267629952:0@lo:400:kworker.0 00000100:00100000:1.0:1789043011.830281:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043011.830303:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789043011.830309:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267629824:0@lo:400:kworker.0 00000100:00100000:1.0:1789043011.830341:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043011.830367:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267629952 00000100:00100000:1.0:1789043011.830373:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267629952 00000100:00100000:1.0:1789043011.830429:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789043011.830437:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875947267629952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789043011.830475:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875947267629952:12345-0@lo:400:kworker.0 Request processed in 40us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043011.830482:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789043011.830500:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267630080 00000100:00100000:1.0:1789043011.830504:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267630080 00000100:00100000:1.0:1789043011.830548:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267629824 00000100:00100000:1.0:1789043011.830551:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267629824 00000100:00100000:1.0:1789043011.830572:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789043011.830579:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a585b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267630080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789043011.830613:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a585b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267630080:12345-0@lo:400:kworker.0 Request processed in 35us (1477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043011.830619:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789043011.830630:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789043011.830636:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267629824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789043011.830661:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267629824:12345-0@lo:400:kworker.0 Request processed in 26us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043011.830677:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1789043011.830709:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789043011.830713:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789043011.830714:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789043011.830733:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267629824:0@lo:400:kworker.0 00000100:00100000:1.0:1789043011.830742:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875947267629952:0@lo:400:kworker.0 00000100:00100000:1.0:1789043011.830768:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1789043011.830773:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1789043011.830786:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267630080:0@lo:400:kworker.0 00000100:00100000:3.0:1789043011.831215:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267629440 00000100:00100000:3.0:1789043011.831221:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267629440 00000100:00100000:3.0:1789043011.831252:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1789043011.831259:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267629440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789043011.831297:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267629440:12345-0@lo:400:kworker.0 Request processed in 39us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043011.831304:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1789043011.832139:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267629440:0@lo:400:kworker.0 00010000:00010000:0.0:1789043011.957044:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789043012.338881:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267630208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789043012.338975:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043012.339187:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267630208 00000100:00100000:3.0:1789043012.339196:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267630208 00000100:00100000:3.0:1789043012.339247:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789043012.339257:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267630208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789043012.339291:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789043012.339355:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267630208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043012.339363:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789043012.339652:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267630208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789043012.440700:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043012.440882:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242452224 00000100:00100000:1.0:1789043012.440893:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242452224 00000100:00100000:1.0:1789043012.440981:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 135 00000100:00100000:1.0:1789043012.440995:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+13:10227:x1875947242452224:12345-192.168.203.17@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789043012.441096:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+13:10227:x1875947242452224:12345-192.168.203.17@tcp:60:lhsmtool_posix.0 Request processed in 106us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043012.441103:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 135 00000100:00080000:3.0:1789043012.441283:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789043012.446728:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043012.446923:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242452480 00000100:00100000:2.0:1789043012.446950:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242452480 00000100:00100000:2.0:1789043012.447028:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 35 00000100:00100000:2.0:1789043012.447039:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a585b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+13:10227:x1875947242452480:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789043012.447372:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a585b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+14:10227:x1875947242452480:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 Request processed in 334us (658us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1789043012.447380:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 35 00000100:00100000:0.0:1789043012.672395:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043012.672489:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242452608 00000100:00100000:1.0:1789043012.672500:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242452608 00000100:00100000:1.0:1789043012.672618:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 136 00000100:00100000:1.0:1789043012.672630:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:11036:x1875947242452608:12345-192.168.203.17@tcp:101:lsof.0 00000100:00080000:3.0:1789043012.672742:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789043012.672965:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043012.672985:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06800 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676ace expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043012.673048:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06807 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043012.673063:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06807 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043012.673076:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06807 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789043012.673111:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789043012.673115:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789043012.673222:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06807 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043012.673248:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06800 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ace expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043012.673265:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06807 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ace expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043012.673273:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a44e19000) 00010000:00010000:1.0:1789043012.673276:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789043012.673280:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41686200, rc 0) 00000100:00100000:1.0:1789043012.673388:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0293780c-6098-470b-9b22-3d24a3d1ef2d+6:11036:x1875947242452608:12345-192.168.203.17@tcp:101:lsof.0 Request processed in 760us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043012.673396:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 136 00000100:00100000:1.0:1789043012.822901:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043012.822965:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043012.823059:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043012.823364:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242452736 00000100:00100000:3.0:1789043012.823375:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242452736 00000100:00100000:3.0:1789043012.823426:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 294 00000100:00100000:3.0:1789043012.823436:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2350:x1875947242452736:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1789043012.823505:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2350:x1875947242452736:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 70us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043012.823559:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 294 00000100:00100000:2.0:1789043012.823777:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242452992 00000100:00100000:2.0:1789043012.823782:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242452992 00000100:00100000:2.0:1789043012.823825:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242452864 00000100:00100000:2.0:1789043012.823828:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242452864 00000100:00100000:2.0:1789043012.823866:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 86 00000100:00100000:2.0:1789043012.823873:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2350:x1875947242452992:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1789043012.823905:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2350:x1875947242452992:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 32us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043012.823911:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 86 00000100:00100000:2.0:1789043012.823924:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 87 00000100:00100000:2.0:1789043012.823942:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2350:x1875947242452864:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1789043012.823963:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2350:x1875947242452864:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 34us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043012.823969:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 87 00000100:00080000:3.0:1789043012.824413:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789043012.824419:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789043012.978948:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789043013.467722:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1789043013.467745:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1789043013.467819:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1789043013.467839:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1789043013.875709:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789043013.875740:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f85e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267630336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789043013.875837:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043013.876228:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267630336 00000100:00100000:1.0:1789043013.876239:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267630336 00000100:00100000:1.0:1789043013.876325:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789043013.876337:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a585b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267630336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789043013.876386:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789043013.876446:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a585b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267630336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043013.876454:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1789043013.876579:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789043013.878288:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f85e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267630336:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789043014.004131:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043015.029190:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043016.051796:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789043016.638545:0:12362:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 08:23:35 (1789043015) 00000100:00100000:1.0:1789043016.946851:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267630848:0@lo:400:kworker.0 00000100:00100000:1.0:1789043016.946926:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043016.946991:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789043016.946998:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f85df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267630464:0@lo:400:kworker.0 00000100:00100000:1.0:1789043016.947042:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043016.947065:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f85e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875947267630976:0@lo:400:kworker.0 00000100:00100000:1.0:1789043016.947092:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043016.947120:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f85f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267630592:0@lo:400:kworker.0 00000100:00100000:1.0:1789043016.947145:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043016.947161:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267631104:0@lo:400:kworker.0 00000100:00100000:1.0:1789043016.947181:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043016.947199:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789043016.947205:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f85ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267630720:0@lo:400:kworker.0 00000100:00100000:1.0:1789043016.947225:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043016.947255:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267630464 00000100:00100000:1.0:1789043016.947275:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267630464 00000100:00100000:1.0:1789043016.947326:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1789043016.947336:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3312:x1875947267630464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789043016.947383:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3312:x1875947267630464:12345-0@lo:400:kworker.0 Request processed in 48us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043016.947390:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1789043016.947422:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267630976 00000100:00100000:1.0:1789043016.947426:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267630976 00000100:00100000:1.0:1789043016.947456:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267630592 00000100:00100000:1.0:1789043016.947459:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267630592 00000100:00100000:1.0:1789043016.947475:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267630720 00000100:00100000:1.0:1789043016.947477:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267630720 00000100:00100000:1.0:1789043016.947493:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789043016.947500:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875947267630976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789043016.947561:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875947267630976:12345-0@lo:400:kworker.0 Request processed in 62us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043016.947567:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789043016.947580:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789043016.947587:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267630592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789043016.947618:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267630592:12345-0@lo:400:kworker.0 Request processed in 32us (472us total) trans 0 rc 0/0 00000100:00080000:3.0:1789043016.947845:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789043016.947881:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789043016.947897:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789043016.947914:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6fc24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267630720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789043016.947946:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6fc24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267630720:12345-0@lo:400:kworker.0 Request processed in 44us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043016.947952:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789043016.947983:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267630848 00000100:00100000:1.0:1789043016.947987:0:8215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267630848 00000100:00080000:3.0:1789043016.948157:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789043016.948227:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267631104 00000100:00100000:1.0:1789043016.948232:0:8215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267631104 00000100:00080000:3.0:1789043016.948283:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789043016.949596:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789043016.949613:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f836680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267630848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789043016.949690:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f836680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267630848:12345-0@lo:400:kworker.0 Request processed in 84us (2763us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043016.949697:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789043016.949715:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789043016.949721:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6fc27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267631104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789043016.949750:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6fc27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267631104:12345-0@lo:400:kworker.0 Request processed in 29us (2568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043016.949756:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789043016.954990:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f85ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267630720:0@lo:400:kworker.0 00000100:00100000:1.0:1789043016.955013:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f85f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267630592:0@lo:400:kworker.0 00000100:00100000:1.0:1789043016.955025:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267631104:0@lo:400:kworker.0 00000100:00100000:1.0:1789043016.955067:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f85df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267630464:0@lo:400:kworker.0 00000100:00100000:1.0:1789043016.955078:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f85e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875947267630976:0@lo:400:kworker.0 00000100:00100000:1.0:1789043016.955089:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267630848:0@lo:400:kworker.0 00010000:00010000:3.0:1789043017.074973:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789043017.464923:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789043017.464954:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267631232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789043017.465029:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043017.465643:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267631232 00000100:00100000:3.0:1789043017.465660:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267631232 00000100:00100000:3.0:1789043017.465743:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789043017.465755:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267631232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789043017.465813:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789043017.465917:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267631232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 164us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043017.465925:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789043017.466735:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267631232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789043017.946712:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043017.946762:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043017.946817:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043017.946924:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242453120 00000100:00100000:1.0:1789043017.946938:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242453120 00000100:00100000:1.0:1789043017.947014:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 296 00000100:00100000:1.0:1789043017.947027:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2349:x1875947242453120:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1789043017.947116:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2349:x1875947242453120:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 92us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043017.947124:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 296 00000100:00100000:0.0:1789043017.947694:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043017.947755:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242453376 00000100:00100000:2.0:1789043017.947762:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242453376 00000100:00100000:2.0:1789043017.947830:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 90 00000100:00100000:2.0:1789043017.947838:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2349:x1875947242453376:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1789043017.947888:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2349:x1875947242453376:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 51us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043017.947906:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 90 00000100:00080000:1.0:1789043017.949967:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789043017.952276:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043017.952474:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242453504 00000100:00100000:2.0:1789043017.952487:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242453504 00000100:00100000:2.0:1789043017.952598:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 91 00000100:00100000:2.0:1789043017.952611:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a77122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2349:x1875947242453504:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1789043017.952703:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a77122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2349:x1875947242453504:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 96us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043017.952711:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 91 00000100:00080000:0.0:1789043017.954672:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789043017.957699:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242453632 00000100:00100000:3.0:1789043017.957740:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242453632 00000100:00100000:3.0:1789043017.957908:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242453248 00000100:00100000:3.0:1789043017.957913:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242453248 00000100:00100000:2.0:1789043017.957982:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 154 00000100:00100000:2.0:1789043017.959007:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0293780c-6098-470b-9b22-3d24a3d1ef2d+6:2349:x1875947242453632:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1789043017.959141:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0293780c-6098-470b-9b22-3d24a3d1ef2d+6:2349:x1875947242453632:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 1147us (12322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043017.959151:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 154 00000100:00080000:0.0:1789043017.962724:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789043017.973416:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 155 00000100:00100000:3.0:1789043017.973446:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a77121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+13:2349:x1875947242453248:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1789043017.973600:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a77121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+13:2349:x1875947242453248:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 168us (25905us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043017.973609:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 155 00000100:00100000:0.0:1789043018.027454:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043018.028014:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242453888 00000100:00100000:1.0:1789043018.028030:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242453888 00000100:00100000:1.0:1789043018.028166:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 137 00000100:00100000:1.0:1789043018.028179:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a77120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+13:11302:x1875947242453888:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789043018.028210:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043018.028249:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c0680e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676ad5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043018.028350:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06815 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043018.028384:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06815 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043018.028400:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06815 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043018.028842:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0681c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043018.028865:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0681c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043018.028877:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0681c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043018.029286:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06823 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043018.029297:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06823 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043018.029305:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06823 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789043018.029316:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1789043018.029460:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06815 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043018.029477:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06815 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043018.029484:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06815 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043018.029491:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687e00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043018.029495:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06815 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043018.029503:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06815 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043018.030083:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa06a55221400) 00010000:00010000:1.0:1789043018.030088:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043018.030094:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06815 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043018.030102:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06815 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043018.030118:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0681c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043018.030124:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0681c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043018.030130:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0681c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043018.030135:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686e00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043018.030146:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0681c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043018.030153:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0681c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043018.030162:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffffa06a44e19b00) 00010000:00010000:1.0:1789043018.030165:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043018.030168:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0681c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043018.030174:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0681c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043018.035121:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c0680e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ad5 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043018.035148:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06823 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ad5 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043018.035157:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa06a44e19600) 00010000:00010000:1.0:1789043018.035160:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043018.035164:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41686600, rc 0) 00000100:00100000:1.0:1789043018.035242:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a77120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+15:11302:x1875947242453888:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 7066us (7803us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1789043018.035251:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 137 00000100:00100000:2.0:1789043018.038972:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043018.039551:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242454016 00000100:00100000:1.0:1789043018.039562:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242454016 00000100:00100000:1.0:1789043018.039632:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 138 00000100:00100000:1.0:1789043018.039654:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+15:11302:x1875947242454016:12345-192.168.203.17@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789043018.039801:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+15:11302:x1875947242454016:12345-192.168.203.17@tcp:59:lhsmtool_posix.0 Request processed in 160us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043018.039809:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 138 00000100:00100000:2.0:1789043018.048708:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043018.049191:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242454144 00000100:00100000:1.0:1789043018.049206:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242454144 00000100:00100000:1.0:1789043018.049287:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00100000:1.0:1789043018.049297:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a453a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+15:2349:x1875947242454144:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789043018.049315:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789043018.049340:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06823 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ad5 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043018.049356:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa06a44e19600) 00010000:00010000:1.0:1789043018.049361:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789043018.049424:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a453a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+14:2349:x1875947242454144:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 129us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043018.049431:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 10 00010000:00010000:0.0:1789043018.099155:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789043018.577826:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000040:00080000:2.0:1789043018.807216:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789043018.807247:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789043018.808510:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789043018.808554:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789043018.994874:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a453a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267631360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789043018.994998:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043018.995147:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267631360 00000100:00100000:2.0:1789043018.995158:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267631360 00000100:00100000:2.0:1789043018.995247:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789043018.995259:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a585b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267631360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789043018.995303:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789043018.995376:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789043018.995601:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a453a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267631360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789043018.995699:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a585b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267631360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 441us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043018.995708:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00010000:1.0:1789043019.132550:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789043019.826781:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789043019.826790:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789043019.827951:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1789043019.827959:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789043019.896717:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043019.896842:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242454272 00000100:00100000:1.0:1789043019.896852:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242454272 00000100:00100000:1.0:1789043019.896937:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 139 00000100:00100000:1.0:1789043019.896953:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a77123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+13:11344:x1875947242454272:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1789043019.896973:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043019.896992:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06831 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676adc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.897054:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06838 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.897075:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06838 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.897087:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06838 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.897102:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c0683f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.897109:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c0683f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.897115:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c0683f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.897401:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06838 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.897410:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06838 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.897417:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06838 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.897423:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686e00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043019.897427:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06838 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.897436:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06838 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.897449:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a44e19000) 00010000:00010000:1.0:1789043019.897459:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043019.897466:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06838 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.897473:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06838 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.897486:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c0683f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.897492:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c0683f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.897498:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c0683f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.897504:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043019.897507:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c0683f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.897548:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c0683f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.897557:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffffa06a44e19100) 00010000:00010000:1.0:1789043019.897560:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043019.897563:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c0683f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.897569:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c0683f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.897604:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06831 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676adc expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.897627:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a44e19000) 00010000:00010000:1.0:1789043019.897630:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043019.897634:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06831 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676adc expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.897644:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41687e00, rc 0) 00000100:00100000:1.0:1789043019.897721:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a77123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+13:11344:x1875947242454272:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 775us (1013us total) trans 0 rc 301/301 00000100:00100000:1.0:1789043019.897729:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 139 00000100:00080000:0.0:1789043019.898674:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789043019.908222:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043019.908308:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242454528 00000100:00100000:1.0:1789043019.908317:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242454528 00000100:00100000:1.0:1789043019.908412:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 140 00000100:00100000:1.0:1789043019.908424:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a585b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+13:11344:x1875947242454528:12345-192.168.203.17@tcp:36:lfs.0 00010000:00010000:1.0:1789043019.908478:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789043019.908504:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687600/0x99260d7389c061af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676915 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.908541:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a44e19000) 00010000:00010000:1.0:1789043019.908546:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789043019.908760:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06846 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.908774:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06807 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ace expref: 5 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.908782:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06846 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.908823:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06807 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ace expref: 5 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.908837:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06807 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ace expref: 5 pid: 5846 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043019.908851:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f834e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875947267631488:192.168.203.17@tcp:104: 00000100:00100000:1.0:1789043019.908948:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7f8ce000 going to sleep for 11 seconds 00000100:00100000:0.0:1789043019.912767:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043019.912918:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f834e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875947267631488:192.168.203.17@tcp:104: 00010000:00010000:1.0:1789043019.912949:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06846 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043019.913005:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242454656 00000100:00100000:3.0:1789043019.913013:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242454656 00010000:00010000:3.0:1789043019.913067:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06807 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ace expref: 6 pid: 5846 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043019.913104:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 61 00000100:00100000:3.0:1789043019.913114:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a77120700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0293780c-6098-470b-9b22-3d24a3d1ef2d+6:2351:x1875947242454656:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789043019.913126:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789043019.913133:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06807 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ace expref: 6 pid: 5846 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043019.913145:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06807 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ace expref: 6 pid: 5846 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043019.913180:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06807 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ace expref: 6 pid: 5846 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043019.913193:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a44e19000) 00010000:00010000:3.0:1789043019.913198:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06846 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043019.913208:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06846 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043019.913215:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06846 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043019.913237:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789043019.913297:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a77120700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2351:x1875947242454656:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 174us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043019.913305:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 61 00010000:00010000:1.0:1789043019.913485:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06846 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.913494:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06846 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.913546:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c0684d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.913556:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c0684d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.913565:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c0684d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789043019.913986:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1789043019.915210:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789043019.915225:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06846 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.915239:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06846 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.915246:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06846 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.915252:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687e00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043019.915257:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06846 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.915266:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06846 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.915281:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a44e19000) 00010000:00010000:1.0:1789043019.915284:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043019.915364:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06846 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.915371:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06846 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789043019.915396:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b6c94f3c reply state 0000000036595603 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c0684d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043019.915405:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789043019.915503:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a585b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+14:11344:x1875947242454528:12345-192.168.203.17@tcp:36:lfs.0 Request processed in 7079us (7285us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1789043019.915532:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 140 00010000:00010000:3.0:1789043019.919039:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c0684d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043019.919055:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c0684d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043019.919062:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c0684d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043019.919067:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789043019.919072:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c0684d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043019.919090:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c0684d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043019.919104:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffffa06a44e19100) 00010000:00010000:3.0:1789043019.919107:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789043019.919113:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c0684d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043019.919119:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c0684d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043019.995044:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043019.995503:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242454784 00000100:00100000:1.0:1789043019.995551:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242454784 00000100:00100000:1.0:1789043019.995683:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 141 00000100:00100000:1.0:1789043019.995693:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a585b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+13:11352:x1875947242454784:12345-192.168.203.17@tcp:101:lctl.0 00010000:00010000:1.0:1789043019.995717:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043019.995740:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06854 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676ae3 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.995806:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687600/0x99260d7389c0685b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.995826:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687600/0x99260d7389c0685b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.995838:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687600/0x99260d7389c0685b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789043019.995872:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789043019.996510:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789043019.996635:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687600/0x99260d7389c0685b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.996666:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06854 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ae3 expref: 15 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.996685:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687600/0x99260d7389c0685b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ae3 expref: 14 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043019.996693:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a44e19000) 00010000:00010000:1.0:1789043019.996696:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789043019.996699:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41687600, rc 0) 00000100:00100000:1.0:1789043019.996769:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a585b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+14:11352:x1875947242454784:12345-192.168.203.17@tcp:101:lctl.0 Request processed in 1077us (1732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043019.996787:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 141 00000100:00100000:1.0:1789043020.073107:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043020.073785:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242454912 00000100:00100000:2.0:1789043020.073803:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242454912 00000100:00100000:2.0:1789043020.073948:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 142 00000100:00100000:2.0:1789043020.073962:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+14:11358:x1875947242454912:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:2.0:1789043020.073993:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043020.074021:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06862 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676aea expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.074105:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06869 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.074123:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06869 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.074161:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06869 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.074180:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06870 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.074188:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06870 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.074195:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06870 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.074317:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979c00/0x99260d7389c06877 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.074325:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979c00/0x99260d7389c06877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.074332:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979c00/0x99260d7389c06877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789043020.074380:0:11703:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789043020.074384:0:11703:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789043020.074407:0:11703:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979c00/0x99260d7389c06877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.074421:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06869 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.074429:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06869 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.074447:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06869 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.074455:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979400 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043020.074460:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06869 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.074468:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06869 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.074482:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a44e19000) 00010000:00010000:2.0:1789043020.074486:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043020.074491:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06869 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.074498:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06869 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.074559:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06870 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.074565:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06870 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.074571:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06870 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.074576:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979a00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043020.074579:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06870 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.074594:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06870 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.074602:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffffa06a457d3b00) 00010000:00010000:2.0:1789043020.074604:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043020.074608:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06870 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.074614:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06870 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.074655:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06862 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aea expref: 16 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.074672:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979c00/0x99260d7389c06877 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aea expref: 15 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.074680:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa06a457d3100) 00010000:00010000:2.0:1789043020.074683:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789043020.074685:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50979c00, rc 0) 00000100:00100000:2.0:1789043020.074772:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+15:11358:x1875947242454912:12345-192.168.203.17@tcp:101:bash.0 Request processed in 813us (1680us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043020.074781:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 142 00000100:00100000:0.0:1789043020.078025:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043020.078418:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242455168 00000100:00100000:1.0:1789043020.078429:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242455168 00000100:00100000:1.0:1789043020.078492:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 143 00000100:00100000:1.0:1789043020.078552:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a77122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+15:11358:x1875947242455168:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:1.0:1789043020.078575:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043020.078596:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c0687e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676af1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.078738:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06885 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.078753:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06885 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.078765:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06885 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.078809:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c0688c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.078817:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c0688c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.078824:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c0688c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789043020.079391:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1789043020.080099:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06893 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.080121:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06893 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.080130:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06893 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.080166:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06885 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.080173:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06885 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.080179:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06885 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.080185:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686e00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043020.080189:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06885 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.080197:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06885 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.080208:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa06a457d3100) 00010000:00010000:1.0:1789043020.080211:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043020.080216:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06885 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.080222:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06885 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789043020.080234:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f81af5e8 reply state 00000000eb1cbfa9 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c0688c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043020.080250:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789043020.080284:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c0687e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676af1 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.080298:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06893 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676af1 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.080305:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:1.0:1789043020.080308:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789043020.080310:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41687000, rc 0) 00000100:00100000:1.0:1789043020.080383:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a77122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+18:11358:x1875947242455168:12345-192.168.203.17@tcp:101:bash.0 Request processed in 1881us (2367us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1789043020.080584:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 143 00010000:00010000:1.0:1789043020.084676:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c0688c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.084697:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c0688c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.084705:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c0688c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.084723:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686600 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043020.084729:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c0688c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.084738:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c0688c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.084777:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa06a44e19e00) 00010000:00010000:1.0:1789043020.084781:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043020.084786:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c0688c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.084793:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c0688c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043020.088715:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043020.088866:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242455296 00000100:00100000:2.0:1789043020.088890:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242455296 00000100:00100000:2.0:1789043020.089070:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 47 00000100:00100000:2.0:1789043020.089094:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a77123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2349:x1875947242455296:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:2.0:1789043020.089142:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043020.089169:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005490156d/0x99260d7389c068a1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676af8 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789043020.089203:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789043020.089227:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=363s v=(0 0) 00010000:00010000:2.0:1789043020.089232:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789043020.089243:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005490156d/0x99260d7389c068a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676af8 expref: 6 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.089266:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005490156d/0x99260d7389c068a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676af8 expref: 6 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.089284:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50978800, rc 0) 00000100:00100000:2.0:1789043020.089720:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a77123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2349:x1875947242455296:12345-192.168.203.17@tcp:101:bash.0 Request processed in 635us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043020.089729:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 47 00000100:00080000:0.0:1789043020.090699:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789043020.092152:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043020.093711:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242455424 00000100:00100000:1.0:1789043020.093728:0:8215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242455424 00000100:00100000:1.0:1789043020.093809:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 48 00000100:00100000:1.0:1789043020.093822:0:8215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a77120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:11358:x1875947242455424:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:1.0:1789043020.093847:0:8215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043020.093874:0:8215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003cfc4be1/0x99260d7389c068a8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676aff expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.093923:0:8215:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005490156d/0x99260d7389c068a1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676af8 expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.093933:0:8215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789043020.093939:0:8215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789043020.093945:0:8215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003cfc4be1/0x99260d7389c068a8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aff expref: 7 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.093992:0:8215:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005490156d/0x99260d7389c068a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676af8 expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.094036:0:8215:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005490156d/0x99260d7389c068a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676af8 expref: 7 pid: 6690 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043020.094054:0:8215:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f85ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8215:1875947267631616:192.168.203.17@tcp:104: 00000100:00100000:1.0:1789043020.094165:0:8215:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7f8ce000 going to sleep for 11 seconds 00000100:00100000:3.0:1789043020.103146:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043020.103237:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242455552 00000100:00100000:1.0:1789043020.103250:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242455552 00010000:00010000:1.0:1789043020.103309:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005490156d/0x99260d7389c068a1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676af8 expref: 8 pid: 6690 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043020.103359:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 62 00000100:00100000:1.0:1789043020.103371:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a585b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:2351:x1875947242455552:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789043020.103389:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789043020.103419:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005490156d/0x99260d7389c068a1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676af8 expref: 8 pid: 6690 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.103446:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005490156d/0x99260d7389c068a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676af8 expref: 8 pid: 6690 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.103480:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789043020.103486:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789043020.103496:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003cfc4be1/0x99260d7389c068a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aff expref: 8 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.103555:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003cfc4be1/0x99260d7389c068a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aff expref: 8 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.103605:0:6705:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003cfc4be1/0x99260d7389c068a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aff expref: 8 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043020.103621:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f85e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6705:1875947267631744:192.168.203.17@tcp:105: 00000100:00100000:1.0:1789043020.103725:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7f8ce480 going to sleep for 11 seconds 00010000:00010000:2.0:1789043020.103825:0:8215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005490156d/0x99260d7389c068a1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676af8 expref: 8 pid: 6690 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043020.103843:0:8215:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f85ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8215:1875947267631616:192.168.203.17@tcp:104: 00010000:00010000:2.0:1789043020.103874:0:8215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003cfc4be1/0x99260d7389c068a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aff expref: 7 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.103895:0:8215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41687e00, rc 0) 00000100:00100000:2.0:1789043020.103941:0:8215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a77120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:11358:x1875947242455424:12345-192.168.203.17@tcp:101:bash.0 Request processed in 10121us (11800us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043020.103949:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 48 00000100:00100000:1.0:1789043020.109121:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043020.109291:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f85e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6705:1875947267631744:192.168.203.17@tcp:105: 00010000:00010000:0.0:1789043020.109331:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789043020.109382:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242455808 00000100:00100000:3.0:1789043020.109392:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242455808 00000100:00100000:0.0:1789043020.109406:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a585b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2351:x1875947242455552:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 6037us (6274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043020.109417:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 62 00000100:00100000:3.0:1789043020.109450:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 36 00000100:00100000:3.0:1789043020.109461:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f85df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+17:11358:x1875947242455808:12345-192.168.203.17@tcp:35:bash.0 00000100:00100000:3.0:1789043020.109896:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f85df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+18:11358:x1875947242455808:12345-192.168.203.17@tcp:35:bash.0 Request processed in 435us (786us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1789043020.109904:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 36 00010000:00010000:3.0:1789043020.154294:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789043020.180816:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043020.181010:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242456064 00000100:00100000:1.0:1789043020.181024:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242456064 00000100:00100000:1.0:1789043020.181109:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 144 00000100:00100000:1.0:1789043020.181122:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a453a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+18:11368:x1875947242456064:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1789043020.181154:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043020.181182:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c068af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676b06 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789043020.181333:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789043020.181571:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c068af lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b06 expref: 20 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.181588:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a44e19000) 00010000:00010000:1.0:1789043020.181592:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789043020.181600:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c068af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b06 expref: 20 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.181642:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41686e00, rc 0) 00000100:00100000:1.0:1789043020.181730:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a453a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+19:11368:x1875947242456064:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 610us (927us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1789043020.181738:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 144 00000100:00100000:1.0:1789043020.185048:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043020.185275:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242456320 00000100:00100000:3.0:1789043020.185290:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242456320 00000100:00100000:3.0:1789043020.185370:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 37 00000100:00100000:3.0:1789043020.185382:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f85f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+19:11368:x1875947242456320:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:3.0:1789043020.186262:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f85f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+20:11368:x1875947242456320:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 875us (1221us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1789043020.186296:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 37 00000100:00100000:2.0:1789043020.300289:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043020.300561:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242456448 00000100:00100000:1.0:1789043020.300574:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242456448 00000100:00100000:1.0:1789043020.300646:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 145 00000100:00100000:1.0:1789043020.300658:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a453a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+20:11374:x1875947242456448:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1789043020.300691:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043020.300717:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c068bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676b0d expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.300813:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c068c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.300831:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c068c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.300843:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c068c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789043020.301018:0:11703:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789043020.301023:0:11703:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789043020.301047:0:11703:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c068c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.301078:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c068bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b0d expref: 22 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.301120:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c068c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b0d expref: 21 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.301131:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa06a457d3100) 00010000:00010000:1.0:1789043020.301134:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789043020.301138:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41687400, rc 0) 00000100:00100000:1.0:1789043020.301217:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a453a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+21:11374:x1875947242456448:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 562us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043020.301225:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 145 00000100:00100000:0.0:1789043020.305699:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043020.305924:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242456704 00000100:00100000:1.0:1789043020.305938:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242456704 00000100:00100000:1.0:1789043020.306123:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 146 00000100:00100000:1.0:1789043020.306136:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a77121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+21:11374:x1875947242456704:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1789043020.306165:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043020.306194:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c068cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676b14 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.306330:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c068d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.306684:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c068d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.306701:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c068d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789043020.306716:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789043020.307129:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c068cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b14 expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.307156:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c068d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b14 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.307166:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:1.0:1789043020.307170:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789043020.307174:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41687200, rc 0) 00000100:00100000:1.0:1789043020.307268:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a77121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+23:11374:x1875947242456704:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 1133us (1586us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1789043020.307278:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 146 00000100:00100000:2.0:1789043020.318720:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043020.320714:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043020.320924:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242456960 00000100:00100000:3.0:1789043020.320939:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242456960 00000100:00100000:3.0:1789043020.321036:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 147 00000100:00100000:3.0:1789043020.321050:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75edc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+23:11374:x1875947242456960:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:3.0:1789043020.321083:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789043020.321111:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c068e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676b1b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.321238:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c068e7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.321257:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c068e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.321272:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c068e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789043020.321287:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789043020.321466:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c068e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b1b expref: 26 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.321488:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c068e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b1b expref: 25 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.321497:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:3.0:1789043020.321501:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789043020.321505:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc28800, rc 0) 00000100:00100000:3.0:1789043020.321624:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75edc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+25:11374:x1875947242456960:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 577us (2919us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1789043020.321632:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 147 00000100:00100000:0.0:1789043020.323119:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242457088 00000100:00100000:0.0:1789043020.323140:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242457088 00000100:00100000:0.0:1789043020.323731:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00100000:0.0:1789043020.323765:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75ede300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+25:2351:x1875947242457088:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789043020.323786:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789043020.323817:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c068d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b14 expref: 25 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043020.323840:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:0.0:1789043020.323846:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789043020.324159:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75ede300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+24:2351:x1875947242457088:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 413us (3456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043020.324188:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00100000:2.0:1789043020.330092:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043020.339937:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242457216 00000100:00100000:0.0:1789043020.339970:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242457216 00000100:00100000:0.0:1789043020.340117:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 49 00000100:00100000:0.0:1789043020.340130:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75edf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2352:x1875947242457216:12345-192.168.203.17@tcp:1:lfs.0 00010000:00010000:0.0:1789043020.340193:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c359890/0x99260d7389c068f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043020.340217:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003cfc4be1/0x99260d7389c068a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aff expref: 6 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043020.340226:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043020.340231:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789043020.340236:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c359890/0x99260d7389c068f5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043020.340281:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003cfc4be1/0x99260d7389c068a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aff expref: 6 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043020.340297:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003cfc4be1/0x99260d7389c068a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aff expref: 6 pid: 8215 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043020.340313:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a77121880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6691:1875947267631872:192.168.203.17@tcp:104: 00000100:00100000:0.0:1789043020.340451:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06943555600 going to sleep for 11 seconds 00000100:00100000:2.0:1789043020.357987:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043020.358180:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242457344 00000100:00100000:1.0:1789043020.358193:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242457344 00002000:00100000:1.0:1789043020.358267:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffffa06a75edc000 x1875947242457344/t0(0) o4->3fb32839-ebfd-4c0f-90e4-f036c86704df@192.168.203.17@tcp:316/0 lens 504/0 e 0 to 0 dl 1789043031 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789043020.358281:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa06a75edc000 with x1875947242457344 ext(0->12) 00010000:00010000:1.0:1789043020.358293:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003cfc4be1/0x99260d7389c068a8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aff expref: 7 pid: 8215 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.358316:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003cfc4be1/0x99260d7389c068a8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aff expref: 7 pid: 8215 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789043020.358324:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa06a75edc000 00000100:00100000:1.0:1789043020.358374:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 2 00000100:00100000:1.0:1789043020.358387:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75edc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2352:x1875947242457344:12345-192.168.203.17@tcp:4:lfs.0 00000100:00100000:1.0:1789043020.359097:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75edc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+9:2352:x1875947242457344:12345-192.168.203.17@tcp:4:lfs.0 Request processed in 710us (1121us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789043020.359112:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 2 00002000:00100000:1.0:1789043020.359122:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffffa06a75edc000 x1875947242457344/t4294967305(0) o4->3fb32839-ebfd-4c0f-90e4-f036c86704df@192.168.203.17@tcp:316/0 lens 504/448 e 0 to 0 dl 1789043031 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789043020.359130:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa06a75edc000 with x1875947242457344 ext(0->12) 00010000:00010000:1.0:1789043020.359137:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003cfc4be1/0x99260d7389c068a8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aff expref: 9 pid: 8215 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.359153:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003cfc4be1/0x99260d7389c068a8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aff expref: 9 pid: 8215 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789043020.359160:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa06a75edc000 00000100:00100000:3.0:1789043020.359660:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a77121880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6691:1875947267631872:192.168.203.17@tcp:104: 00010000:00010000:3.0:1789043020.359694:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007c359890/0x99260d7389c068f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043020.363368:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043020.363494:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242457472 00000100:00100000:3.0:1789043020.363509:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242457472 00010000:00010000:3.0:1789043020.363597:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003cfc4be1/0x99260d7389c068a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aff expref: 9 pid: 8215 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043020.363655:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 63 00000100:00100000:3.0:1789043020.363668:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a77120e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+9:2351:x1875947242457472:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789043020.363689:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789043020.363718:0:5831:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789043020.363721:0:5831:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789043020 00002000:00010000:3.0:1789043020.363723:0:5831:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789043020 00002000:00010000:3.0:1789043020.363726:0:5831:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789043020 00010000:00010000:3.0:1789043020.363733:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003cfc4be1/0x99260d7389c068a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aff expref: 9 pid: 8215 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.363751:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003cfc4be1/0x99260d7389c068a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aff expref: 9 pid: 8215 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.363780:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003cfc4be1/0x99260d7389c068a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aff expref: 9 pid: 8215 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.363812:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789043020.363817:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789043020.363825:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007c359890/0x99260d7389c068f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.363836:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c359890/0x99260d7389c068f5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.363867:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789043020.364045:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007c359890/0x99260d7389c068f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043020.364056:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c359890/0x99260d7389c068f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043020.364086:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c359890/0x99260d7389c068f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043020.364096:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c359890/0x99260d7389c068f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043020.364104:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c359890/0x99260d7389c068f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043020.364111:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a40031a00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789043020.364116:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c359890/0x99260d7389c068f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043020.364126:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c359890/0x99260d7389c068f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043020.364140:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c359890/0x99260d7389c068f5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043020.364148:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c359890/0x99260d7389c068f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043020.364265:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75edf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:2352:x1875947242457216:12345-192.168.203.17@tcp:1:lfs.0 Request processed in 24136us (34186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043020.364274:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 49 00000100:00100000:3.0:1789043020.364501:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a77120e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2351:x1875947242457472:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 836us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043020.364509:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 63 00000100:00100000:2.0:1789043020.368801:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043020.369133:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242457728 00000100:00100000:3.0:1789043020.369148:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242457728 00000100:00100000:3.0:1789043020.369212:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 38 00000100:00100000:3.0:1789043020.369224:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a50c20850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+24:11374:x1875947242457728:12345-192.168.203.17@tcp:35:lfs.0 00000004:00010000:3.0:1789043020.369305:0:5849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c068e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b1b expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789043020.369738:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1789043020.369789:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1789043020.376343:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1789043020.378405:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c068fc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.378445:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06893 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676af1 expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.378456:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c068fc lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.378581:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06893 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676af1 expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.378604:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06893 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676af1 expref: 28 pid: 5846 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043020.378624:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f872680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5849:1875947267632000:192.168.203.17@tcp:104: 00000100:00100000:2.0:1789043020.378757:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a464c76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789043020.382475:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043020.382906:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f872680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5849:1875947267632000:192.168.203.17@tcp:104: 00010000:00010000:0.0:1789043020.382953:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c068fc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043020.383089:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242457856 00000100:00100000:1.0:1789043020.383099:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242457856 00010000:00010000:1.0:1789043020.383150:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06893 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676af1 expref: 29 pid: 5846 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043020.383196:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 64 00000100:00100000:1.0:1789043020.383208:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46f88050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+29:2351:x1875947242457856:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789043020.383226:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789043020.383234:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06893 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676af1 expref: 29 pid: 5846 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.383248:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06893 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676af1 expref: 29 pid: 5846 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.383274:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06893 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676af1 expref: 29 pid: 5846 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.383311:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:1.0:1789043020.383316:0:6705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c068fc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.383326:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c068fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.383335:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c068fc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.383379:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789043020.383455:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46f88050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+28:2351:x1875947242457856:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 249us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043020.383464:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 64 00010000:00010000:2.0:1789043020.383720:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c068fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.383730:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c068fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789043020.383905:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1789043020.384164:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1789043020.384298:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f871c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1875947267632128:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789043020.384372:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043020.384408:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a464c76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789043020.384572:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267632128 00000100:00100000:1.0:1789043020.384581:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267632128 00000100:00100000:1.0:1789043020.384656:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789043020.384667:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1875947267632128:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789043020.384755:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1875947267632128:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 89us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043020.384763:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1789043020.387086:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789043020.387176:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f871c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1875947267632128:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789043020.387920:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1789043020.388036:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f871c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1875947267632256:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789043020.388134:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043020.388177:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a464c79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789043020.388645:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267632256 00000100:00100000:1.0:1789043020.388659:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267632256 00000100:00100000:1.0:1789043020.388740:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789043020.388753:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1875947267632256:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789043020.389069:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5849:x1875947267632256:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 318us (934us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789043020.389088:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789043020.389333:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f871c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1875947267632256:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789043020.389435:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1789043020.389500:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c068fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.389549:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c068fc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.389558:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c068fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.389566:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979800 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789043020.389572:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c068fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.389582:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c068fc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.389604:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:3.0:1789043020.389608:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789043020.389614:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c068fc lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.389622:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c068fc lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789043020.390066:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789043020.390223:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1789043020.390238:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 363346723459ns, next at 364346720904ns, rc = 0 00000001:00080000:0.0:1789043020.390247:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1789043020.390296:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:0.0:1789043020.390299:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789043020.390309:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c068e7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b1b expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043020.390470:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a50c20850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+31:11374:x1875947242457728:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 21248us (21683us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1789043020.390480:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 38 00000020:00080000:0.0:1789043020.390486:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789043020.393368:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043020.393508:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242457984 00000100:00100000:1.0:1789043020.393559:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242457984 00000100:00100000:1.0:1789043020.393641:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 148 00000100:00100000:1.0:1789043020.393656:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+31:11374:x1875947242457984:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1789043020.393688:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043020.393716:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06903 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676b22 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.393793:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06903 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b22 expref: 32 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.393810:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06903 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b22 expref: 32 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.393833:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19e00) 00010000:00010000:1.0:1789043020.393837:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789043020.393842:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41687000, rc 0) 00000100:00100000:1.0:1789043020.393924:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+32:11374:x1875947242457984:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 273us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043020.393932:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 148 00000100:00100000:3.0:1789043020.400666:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043020.400796:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242458240 00000100:00100000:0.0:1789043020.400809:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242458240 00000100:00100000:0.0:1789043020.400893:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 39 00000100:00100000:0.0:1789043020.400906:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a585b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+32:11374:x1875947242458240:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:0.0:1789043020.401226:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a585b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+33:11374:x1875947242458240:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 322us (576us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1789043020.401253:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 39 00000100:00100000:3.0:1789043020.531371:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043020.531559:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242458496 00000100:00100000:1.0:1789043020.531573:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242458496 00000100:00100000:1.0:1789043020.531655:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 149 00000100:00100000:1.0:1789043020.531668:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a585b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+33:11384:x1875947242458496:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1789043020.531701:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043020.531747:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c0690a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676b29 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789043020.531894:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789043020.532065:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c0690a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b29 expref: 35 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.532080:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a44e19000) 00010000:00010000:1.0:1789043020.532084:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789043020.532090:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c0690a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b29 expref: 35 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.532108:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41686600, rc 0) 00000100:00100000:1.0:1789043020.532183:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a585b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+34:11384:x1875947242458496:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 518us (846us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1789043020.532191:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 149 00000100:00100000:2.0:1789043020.536278:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043020.536387:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242458624 00000100:00100000:1.0:1789043020.536401:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242458624 00000100:00100000:1.0:1789043020.536489:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 150 00000100:00100000:1.0:1789043020.536502:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+34:11384:x1875947242458624:12345-192.168.203.17@tcp:34:lfs.0 00010000:00010000:1.0:1789043020.536649:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06918 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.536672:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06918 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.536686:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06918 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.536728:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c0691f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.536735:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c0691f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.536741:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c0691f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.536859:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06926 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.536868:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06926 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.536884:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06926 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789043020.536940:0:11703:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06926 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.536956:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06918 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.536964:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06918 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.536972:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06918 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.536978:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686e00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043020.536983:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06918 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.537003:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06918 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.537018:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa06a457d3100) 00010000:00010000:1.0:1789043020.537021:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043020.537027:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06918 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.537034:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06918 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.537051:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c0691f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.537057:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c0691f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.537062:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c0691f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.537067:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043020.537070:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c0691f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.537075:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c0691f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.537082:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa06a44e19f00) 00010000:00010000:1.0:1789043020.537085:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043020.537088:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c0691f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.537104:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c0691f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.537121:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06926 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.537127:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06926 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.537133:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06926 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.537138:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687e00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043020.537142:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06926 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.537148:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06926 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.537155:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19e00) 00010000:00010000:1.0:1789043020.537158:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043020.537161:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06926 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.537168:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06926 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043020.537269:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+34:11384:x1875947242458624:12345-192.168.203.17@tcp:34:lfs.0 Request processed in 768us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043020.537278:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 150 00000100:00100000:0.0:1789043020.540625:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043020.540748:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242458880 00000100:00100000:1.0:1789043020.540761:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242458880 00000100:00100000:1.0:1789043020.540842:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 40 00000100:00100000:1.0:1789043020.540855:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a77123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+34:11384:x1875947242458880:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:1.0:1789043020.541187:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a77123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+35:11384:x1875947242458880:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 336us (579us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1789043020.541196:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 40 00000100:00100000:2.0:1789043020.579310:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043020.579558:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242459136 00000100:00100000:1.0:1789043020.579574:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242459136 00000100:00100000:1.0:1789043020.579658:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 151 00000100:00100000:1.0:1789043020.579672:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+35:11387:x1875947242459136:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1789043020.579707:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043020.579735:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c0692d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676b30 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.579838:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06934 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.579856:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06934 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.579871:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06934 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.579899:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0693b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.579906:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0693b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.579939:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0693b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.580098:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06942 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.580108:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06942 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.580116:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06942 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789043020.580128:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789043020.580257:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06934 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.580267:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06934 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.580274:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06934 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.580281:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043020.580285:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06934 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.580294:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06934 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.580308:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa06a457d3100) 00010000:00010000:1.0:1789043020.580312:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043020.580326:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06934 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.580333:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06934 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.580620:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0693b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.580630:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0693b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.580637:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0693b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.580643:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686e00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043020.580646:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0693b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.580653:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0693b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.580663:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa06a44e19f00) 00010000:00010000:1.0:1789043020.580666:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043020.580670:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0693b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.580677:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c0693b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.580739:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c0692d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b30 expref: 38 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.580769:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06942 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b30 expref: 37 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.580778:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19e00) 00010000:00010000:1.0:1789043020.580781:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789043020.580784:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41686600, rc 0) 00000100:00100000:1.0:1789043020.580886:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+37:11387:x1875947242459136:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 1206us (1581us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1789043020.580896:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 151 00000100:00100000:2.0:1789043020.584239:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043020.584348:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242459264 00000100:00100000:3.0:1789043020.584371:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242459264 00000100:00100000:3.0:1789043020.584640:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 152 00000100:00100000:3.0:1789043020.584653:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f872300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+37:11387:x1875947242459264:12345-192.168.203.17@tcp:54:lfs.0 00010000:00010000:3.0:1789043020.584752:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06950 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.584798:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06950 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.584814:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06950 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.584852:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06950 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.584860:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06950 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.584869:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06950 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.584887:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc29000 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789043020.584892:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06950 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.584901:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06950 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.584915:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19e00) 00010000:00010000:3.0:1789043020.584918:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789043020.584925:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06950 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.584932:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06950 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043020.585029:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f872300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+37:11387:x1875947242459264:12345-192.168.203.17@tcp:54:lfs.0 Request processed in 377us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043020.585044:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 152 00000100:00100000:0.0:1789043020.587988:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043020.588079:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242459520 00000100:00100000:1.0:1789043020.588092:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242459520 00000100:00100000:1.0:1789043020.588169:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 41 00000100:00100000:1.0:1789043020.588183:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a77123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+37:11387:x1875947242459520:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:1.0:1789043020.588734:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a77123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+38:11387:x1875947242459520:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 550us (755us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1789043020.588744:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 41 00000100:00100000:2.0:1789043020.829158:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043020.829300:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242459776 00000100:00100000:3.0:1789043020.829314:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242459776 00000100:00100000:3.0:1789043020.829456:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 153 00000100:00100000:3.0:1789043020.829474:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+38:11418:x1875947242459776:12345-192.168.203.17@tcp:101:cat.0 00010000:00010000:3.0:1789043020.829510:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789043020.829564:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06957 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676b37 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.829708:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c0695e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.829727:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c0695e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.829742:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c0695e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789043020.829757:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789043020.829934:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06957 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b37 expref: 41 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.829956:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c0695e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b37 expref: 40 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.829965:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19e00) 00010000:00010000:3.0:1789043020.829968:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789043020.829972:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc29200, rc 0) 00000100:00100000:3.0:1789043020.830183:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+40:11418:x1875947242459776:12345-192.168.203.17@tcp:101:cat.0 Request processed in 714us (1039us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1789043020.830191:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 153 00000100:00100000:2.0:1789043020.838111:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043020.838220:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242460032 00000100:00100000:0.0:1789043020.838233:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242460032 00000100:00100000:0.0:1789043020.838307:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 42 00000100:00100000:0.0:1789043020.838319:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f870380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+40:11418:x1875947242460032:12345-192.168.203.17@tcp:35:cat.0 00000100:00100000:0.0:1789043020.838706:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f870380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+41:11418:x1875947242460032:12345-192.168.203.17@tcp:35:cat.0 Request processed in 387us (610us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1789043020.838714:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 42 00000100:00100000:0.0:1789043020.841174:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043020.842384:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242460160 00000100:00100000:2.0:1789043020.842405:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242460160 00000100:00100000:2.0:1789043020.842568:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 12 00000100:00100000:2.0:1789043020.842583:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a77121500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+41:2351:x1875947242460160:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789043020.842629:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789043020.842662:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c0695e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b37 expref: 41 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.842689:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19e00) 00010000:00010000:2.0:1789043020.842695:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789043020.842783:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a77121500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+40:2351:x1875947242460160:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 202us (1623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043020.842791:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 12 00000100:00100000:2.0:1789043020.900059:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043020.900232:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242460416 00000100:00100000:3.0:1789043020.900245:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242460416 00000100:00100000:3.0:1789043020.900367:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 154 00000100:00100000:3.0:1789043020.900380:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+40:11424:x1875947242460416:12345-192.168.203.17@tcp:101:dd.0 00010000:00010000:3.0:1789043020.900413:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789043020.900417:0:6714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789043020.900453:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c068c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b0d expref: 40 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.900476:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa06a457d3100) 00010000:00010000:3.0:1789043020.900482:0:6714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789043020.900499:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c0696c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676b3e expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.900696:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06973 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.900713:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06942 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b30 expref: 40 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.900723:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06973 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.900763:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06942 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b30 expref: 40 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.900811:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06942 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b30 expref: 40 pid: 5847 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043020.900828:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a585b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875947267632384:192.168.203.17@tcp:104: 00000100:00100000:3.0:1789043020.900955:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7a8e5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789043020.905112:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043020.905190:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242460544 00000100:00100000:2.0:1789043020.905201:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242460544 00000100:00100000:1.0:1789043020.905207:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a585b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875947267632384:192.168.203.17@tcp:104: 00010000:00010000:1.0:1789043020.905242:0:6714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06973 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.905247:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06942 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b30 expref: 41 pid: 5847 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043020.905281:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 65 00000100:00100000:2.0:1789043020.905292:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a585b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+41:2351:x1875947242460544:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789043020.905312:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789043020.905320:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06942 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b30 expref: 41 pid: 5847 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.905339:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06942 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b30 expref: 41 pid: 5847 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.905366:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06942 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b30 expref: 41 pid: 5847 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.905410:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19e00) 00010000:00010000:2.0:1789043020.905417:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06973 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.905428:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06973 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.905436:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06973 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.905470:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789043020.905559:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a585b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+40:2351:x1875947242460544:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 267us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043020.905566:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 65 00010000:00010000:1.0:1789043020.905632:0:6714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06973 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.905640:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06973 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789043020.905674:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789043020.905955:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c0696c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b3e expref: 41 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.905974:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06973 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b3e expref: 40 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043020.905982:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19e00) 00010000:00010000:1.0:1789043020.905984:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789043020.905987:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc29200, rc 0) 00000100:00100000:1.0:1789043020.906019:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+40:11424:x1875947242460416:12345-192.168.203.17@tcp:101:dd.0 Request processed in 5642us (5974us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1789043020.906026:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 154 00000100:00100000:2.0:1789043020.909840:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043020.909952:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242460800 00000100:00100000:3.0:1789043020.909966:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242460800 00000100:00100000:3.0:1789043020.910040:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 155 00000100:00100000:3.0:1789043020.910052:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+40:11424:x1875947242460800:12345-192.168.203.17@tcp:36:dd.0 00010000:00010000:3.0:1789043020.910405:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06981 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.910424:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06981 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043020.910434:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06981 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789043020.910495:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1789043020.910574:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b4c8a203 reply state 0000000076d10b38 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06981 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043020.910584:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789043020.910702:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+43:11424:x1875947242460800:12345-192.168.203.17@tcp:36:dd.0 Request processed in 650us (876us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1789043020.910711:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 155 00000020:00080000:3.0:1789043020.910736:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789043020.913065:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06981 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.913101:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06981 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.913110:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06981 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.913116:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc28400 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043020.913122:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06981 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.913131:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06981 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.913161:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19e00) 00010000:00010000:2.0:1789043020.913164:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043020.913172:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06981 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043020.913180:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06981 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043021.089882:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043021.090703:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242460928 00000100:00100000:3.0:1789043021.090719:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242460928 00000100:00100000:3.0:1789043021.090795:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 156 00000100:00100000:3.0:1789043021.090805:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f870e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+42:11439:x1875947242460928:12345-192.168.203.17@tcp:101:stat.0 00010000:00010000:3.0:1789043021.090831:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789043021.090853:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06988 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676b45 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789043021.090889:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789043021.090930:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c0698f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043021.090946:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c0698f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043021.090958:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c0698f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043021.090971:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06996 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043021.090978:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06996 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043021.090985:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06996 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043021.091068:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c0699d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043021.091080:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06973 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b3e expref: 43 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043021.091107:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c0699d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043021.091139:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06973 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b3e expref: 43 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043021.091153:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06973 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b3e expref: 43 pid: 6714 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043021.091167:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a585b3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875947267632512:192.168.203.17@tcp:104: 00000100:00100000:3.0:1789043021.091266:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7a8e50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789043021.099583:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043021.099699:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a585b3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875947267632512:192.168.203.17@tcp:104: 00010000:00010000:1.0:1789043021.099739:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c0699d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043021.099845:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242461184 00000100:00100000:0.0:1789043021.099855:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242461184 00000100:00100000:0.0:1789043021.099941:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 43 00000100:00100000:0.0:1789043021.099954:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a585b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+44:5593:x1875947242461184:12345-192.168.203.17@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789043021.100412:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a585b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+45:5593:x1875947242461184:12345-192.168.203.17@tcp:35:ldlm_bl.0 Request processed in 458us (838us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1789043021.100421:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 43 00000100:00100000:2.0:1789043021.108478:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043021.108928:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242461312 00000100:00100000:0.0:1789043021.108945:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242461312 00010000:00010000:0.0:1789043021.109006:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06973 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b3e expref: 45 pid: 6714 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043021.109087:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 66 00000100:00100000:0.0:1789043021.109115:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f873100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+45:2351:x1875947242461312:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789043021.109174:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789043021.109183:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06973 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b3e expref: 45 pid: 6714 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043021.109199:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06973 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b3e expref: 45 pid: 6714 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043021.109247:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06973 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b3e expref: 45 pid: 6714 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043021.109268:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19e00) 00010000:00010000:0.0:1789043021.109274:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c0699d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043021.109285:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c0699d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043021.109294:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c0699d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043021.109354:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789043021.109481:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f873100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+44:2351:x1875947242461312:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 369us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043021.109501:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 66 00010000:00010000:1.0:1789043021.109795:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c0699d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.109806:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c0699d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789043021.109864:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789043021.109870:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789043021.109907:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c0699d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.109940:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c0699d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.109952:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c0698f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.109960:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c0698f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.109968:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c0698f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.109975:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc28a00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043021.109980:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c0698f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.109990:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c0698f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.110001:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa06a457d3100) 00010000:00010000:1.0:1789043021.110004:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043021.110009:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c0698f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.110016:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c0698f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.110031:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06996 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.110037:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06996 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.110049:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06996 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.110054:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc28200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043021.110057:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06996 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.110064:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06996 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.110072:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa06a55d80000) 00010000:00010000:1.0:1789043021.110075:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043021.110078:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06996 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.110084:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06996 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.110149:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06988 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b45 expref: 44 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.110166:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c0699d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b45 expref: 43 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.110173:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19e00) 00010000:00010000:1.0:1789043021.110176:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789043021.110178:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc28400, rc 0) 00000100:00100000:1.0:1789043021.110230:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f870e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+43:11439:x1875947242460928:12345-192.168.203.17@tcp:101:stat.0 Request processed in 19427us (20373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043021.110261:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 156 00000100:00100000:2.0:1789043021.169088:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043021.169213:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242461568 00000100:00100000:1.0:1789043021.169227:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242461568 00000100:00100000:1.0:1789043021.169305:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 157 00000100:00100000:1.0:1789043021.169317:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+43:11445:x1875947242461568:12345-192.168.203.17@tcp:36:truncate.0 00010000:00010000:1.0:1789043021.169424:0:6714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789043021.169461:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c0699d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b45 expref: 43 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.169498:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19e00) 00010000:00010000:1.0:1789043021.169505:0:6714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789043021.169841:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c069a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.169855:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c069a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.169865:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c069a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789043021.169938:0:6714:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1789043021.169966:0:6714:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f4a0d213 reply state 00000000ee2ca060 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c069a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043021.169976:0:6714:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789043021.170333:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+45:11445:x1875947242461568:12345-192.168.203.17@tcp:36:truncate.0 Request processed in 1017us (1260us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1789043021.170342:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 157 00000020:00080000:1.0:1789043021.170356:0:6714:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789043021.175510:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043021.176601:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c069a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.176624:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c069a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.176633:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c069a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.176639:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687e00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043021.176646:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c069a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.176656:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c069a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.176678:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19e00) 00010000:00010000:1.0:1789043021.176682:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043021.176688:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c069a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.176695:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c069a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043021.315085:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043021.316077:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242461696 00000100:00100000:1.0:1789043021.316095:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242461696 00000100:00100000:1.0:1789043021.316194:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 158 00000100:00100000:1.0:1789043021.316207:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+44:11459:x1875947242461696:12345-192.168.203.17@tcp:101:stat.0 00010000:00010000:1.0:1789043021.316242:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043021.316271:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c069ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676b4c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.317242:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c069b2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.317264:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c069b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.317279:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c069b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.317297:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c069b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.317305:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c069b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.317312:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c069b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.317680:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c069c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.317690:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c069c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.317698:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c069c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789043021.317744:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1789043021.317750:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789043021.317953:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c069c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.317987:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c069c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.317998:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c069b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.318005:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c069b2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.318013:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c069b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.318021:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686e00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043021.318026:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c069b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.318035:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c069b2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.318049:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa06a457d3100) 00010000:00010000:1.0:1789043021.318053:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043021.318059:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c069b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.318067:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c069b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.318082:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c069b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.318089:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c069b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.318101:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c069b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.318107:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043021.318110:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c069b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.318117:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c069b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.318126:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa06a44e19f00) 00010000:00010000:1.0:1789043021.318129:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043021.318132:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c069b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.318137:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c069b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.318183:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c069ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b4c expref: 46 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.318201:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c069c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b4c expref: 45 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.318209:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19e00) 00010000:00010000:1.0:1789043021.318211:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789043021.318214:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41687200, rc 0) 00000100:00100000:1.0:1789043021.318310:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+45:11459:x1875947242461696:12345-192.168.203.17@tcp:101:stat.0 Request processed in 2105us (3238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043021.318331:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 158 00000100:00100000:3.0:1789043021.406982:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043021.407092:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242461952 00000100:00100000:1.0:1789043021.407102:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242461952 00000100:00100000:1.0:1789043021.407165:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 159 00000100:00100000:1.0:1789043021.407177:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a585b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+45:11469:x1875947242461952:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1789043021.407197:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043021.407220:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c069c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676b53 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789043021.407304:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789043021.407553:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c069c7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b53 expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.407568:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a44e19000) 00010000:00010000:1.0:1789043021.407571:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789043021.407576:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c069c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b53 expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.407591:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41687e00, rc 0) 00000100:00100000:1.0:1789043021.407713:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a585b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+46:11469:x1875947242461952:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 538us (740us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1789043021.407721:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 159 00000100:00100000:2.0:1789043021.416053:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043021.418974:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242462208 00000100:00100000:0.0:1789043021.418990:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242462208 00000100:00100000:0.0:1789043021.419067:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 44 00000100:00100000:0.0:1789043021.419078:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5ffde850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+46:11469:x1875947242462208:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:0.0:1789043021.419314:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5ffde850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+47:11469:x1875947242462208:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 236us (3274us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1789043021.419321:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 44 00000100:00100000:2.0:1789043021.519763:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043021.522842:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242462464 00000100:00100000:1.0:1789043021.522865:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242462464 00000100:00100000:1.0:1789043021.523003:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 160 00000100:00100000:1.0:1789043021.523018:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+47:11475:x1875947242462464:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:1.0:1789043021.523078:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043021.523105:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c069d5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676b5a expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.524721:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c069dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.524754:0:6714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c069c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b4c expref: 48 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.524765:0:6714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c069dc lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.524820:0:6714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c069c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b4c expref: 48 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.526331:0:6714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c069c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b4c expref: 48 pid: 5847 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043021.526473:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f85ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875947267632640:192.168.203.17@tcp:104: 00000100:00100000:1.0:1789043021.528706:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7f8ce840 going to sleep for 11 seconds 00000100:00100000:1.0:1789043021.533821:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f85ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6714:1875947267632640:192.168.203.17@tcp:104: 00010000:00010000:1.0:1789043021.533883:0:6714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c069dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043021.535491:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043021.536243:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242462592 00000100:00100000:1.0:1789043021.536259:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242462592 00010000:00010000:1.0:1789043021.536322:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c069c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b4c expref: 49 pid: 5847 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043021.536590:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 67 00000100:00100000:1.0:1789043021.536604:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f870000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+49:2352:x1875947242462592:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789043021.536624:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789043021.536633:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c069c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b4c expref: 49 pid: 5847 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.536649:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c069c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b4c expref: 49 pid: 5847 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.536675:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c069c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b4c expref: 49 pid: 5847 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.536695:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19e00) 00010000:00010000:1.0:1789043021.536701:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c069dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.536712:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c069dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.536721:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c069dc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.536759:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789043021.536838:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f870000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+48:2352:x1875947242462592:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 237us (1358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043021.536848:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 67 00010000:00010000:3.0:1789043021.536853:0:6714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c069dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043021.536866:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c069dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789043021.537017:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1789043021.537250:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c069d5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b5a expref: 49 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043021.537270:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c069dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b5a expref: 48 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043021.537278:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19e00) 00010000:00010000:3.0:1789043021.537290:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789043021.537294:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41686200, rc 0) 00000100:00100000:3.0:1789043021.537324:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+48:11475:x1875947242462464:12345-192.168.203.17@tcp:101:bash.0 Request processed in 14311us (17577us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1789043021.537332:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 160 00000100:00100000:3.0:1789043021.548243:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043021.551291:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242462848 00000100:00100000:1.0:1789043021.551345:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242462848 00000100:00100000:1.0:1789043021.551895:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 161 00000100:00100000:1.0:1789043021.551912:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a585b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+48:11475:x1875947242462848:12345-192.168.203.17@tcp:36:bash.0 00010000:00010000:1.0:1789043021.552367:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c069ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.552392:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c069ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.552407:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c069ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789043021.552471:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1789043021.552508:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000079a105e3 reply state 0000000063542ef7 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c069ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043021.552825:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789043021.552975:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a585b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+51:11475:x1875947242462848:12345-192.168.203.17@tcp:36:bash.0 Request processed in 1064us (4745us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1789043021.552984:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 161 00000020:00080000:1.0:1789043021.552990:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789043021.557772:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c069ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043021.557795:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c069ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043021.557805:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c069ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043021.557811:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789043021.557817:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c069ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043021.557826:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c069ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043021.557846:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19e00) 00010000:00010000:3.0:1789043021.557849:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789043021.557855:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c069ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043021.557862:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c069ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043021.560782:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043021.561593:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242462976 00000100:00100000:1.0:1789043021.561620:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242462976 00000100:00100000:1.0:1789043021.561714:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 162 00000100:00100000:1.0:1789043021.561728:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a77123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+50:11475:x1875947242462976:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:1.0:1789043021.561759:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043021.561785:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c069f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676b61 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.561900:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c069f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.561929:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c069dc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b5a expref: 51 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.561939:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c069f8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.561983:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c069dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b5a expref: 51 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.561999:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c069dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b5a expref: 51 pid: 6714 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043021.562016:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f85ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875947267632768:192.168.203.17@tcp:104: 00000100:00100000:1.0:1789043021.562247:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7f8cea80 going to sleep for 11 seconds 00000100:00100000:1.0:1789043021.566749:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f85ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875947267632768:192.168.203.17@tcp:104: 00010000:00010000:1.0:1789043021.566802:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c069f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043021.579111:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043021.580025:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242463104 00000100:00100000:3.0:1789043021.580060:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242463104 00010000:00010000:3.0:1789043021.580113:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c069dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b5a expref: 52 pid: 6714 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043021.580175:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 68 00000100:00100000:3.0:1789043021.580186:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f85ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+52:2352:x1875947242463104:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789043021.580205:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789043021.580214:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c069dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b5a expref: 52 pid: 6714 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043021.580230:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c069dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b5a expref: 52 pid: 6714 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043021.580259:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c069dc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b5a expref: 52 pid: 6714 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043021.580276:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19e00) 00010000:00010000:3.0:1789043021.580282:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c069f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043021.580294:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c069f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043021.580303:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c069f8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043021.580331:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789043021.580743:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c069f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.580754:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c069f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789043021.580812:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789043021.580817:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789043021.580845:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c069f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.580904:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c069f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b61 expref: 52 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.580924:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c069f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b61 expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.580931:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19e00) 00010000:00010000:1.0:1789043021.580935:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789043021.580937:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41687e00, rc 0) 00000100:00100000:1.0:1789043021.581011:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a77123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+51:11475:x1875947242462976:12345-192.168.203.17@tcp:101:bash.0 Request processed in 19285us (20239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043021.581019:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 162 00000100:00100000:3.0:1789043021.583170:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f85ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+50:2352:x1875947242463104:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 2968us (4057us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043021.583207:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 68 00000100:00100000:3.0:1789043021.596217:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043021.596268:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242463360 00000100:00100000:3.0:1789043021.596283:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242463360 00000100:00100000:3.0:1789043021.596344:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 45 00000100:00100000:3.0:1789043021.596357:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a585b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+50:11475:x1875947242463360:12345-192.168.203.17@tcp:35:bash.0 00000100:00100000:2.0:1789043021.596791:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a585b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+51:11475:x1875947242463360:12345-192.168.203.17@tcp:35:bash.0 Request processed in 434us (585us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1789043021.596801:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 45 00000001:00080000:1.0:1789043021.611081:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:1.0:1789043021.611103:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:3.0:1789043021.696380:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043021.696575:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242463616 00000100:00100000:1.0:1789043021.696585:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242463616 00000100:00100000:1.0:1789043021.696653:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 163 00000100:00100000:1.0:1789043021.696665:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a585b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+51:11485:x1875947242463616:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1789043021.696688:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043021.696708:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c069ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676b68 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789043021.696792:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789043021.696918:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c069ff lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b68 expref: 53 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.696950:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a44e19000) 00010000:00010000:1.0:1789043021.696953:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789043021.696959:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c069ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b68 expref: 53 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.696972:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41686e00, rc 0) 00000100:00100000:1.0:1789043021.697042:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a585b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+52:11485:x1875947242463616:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 380us (671us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1789043021.697050:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 163 00000100:00100000:0.0:1789043021.700271:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043021.700361:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242463744 00000100:00100000:1.0:1789043021.700370:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242463744 00000100:00100000:1.0:1789043021.700432:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 164 00000100:00100000:1.0:1789043021.700455:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a77123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+52:11485:x1875947242463744:12345-192.168.203.17@tcp:34:lfs.0 00010000:00010000:1.0:1789043021.700551:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06a0d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.700570:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06a0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.700582:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06a0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.700597:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06a14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.700604:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06a14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.700632:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06a14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.700721:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06a1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.700731:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06a1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.700738:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06a1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789043021.700779:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06a1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.700791:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06a0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.700799:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06a0d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.700805:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06a0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.700811:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043021.700815:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06a0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.700822:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06a0d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.700833:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa06a457d3100) 00010000:00010000:1.0:1789043021.700842:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043021.700848:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06a0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.700854:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06a0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.700880:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06a14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.700887:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06a14 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.700892:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06a14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.700898:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687400 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043021.700900:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06a14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.700906:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06a14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.700914:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa06a44e19f00) 00010000:00010000:1.0:1789043021.700917:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043021.700920:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06a14 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.700925:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06a14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.700940:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06a1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.700954:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06a1b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.700960:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06a1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.700965:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043021.700968:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06a1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.700975:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06a1b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.700983:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19e00) 00010000:00010000:1.0:1789043021.700986:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043021.700989:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06a1b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.700994:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06a1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043021.701069:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a77123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+52:11485:x1875947242463744:12345-192.168.203.17@tcp:34:lfs.0 Request processed in 617us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043021.701077:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 164 00000100:00100000:0.0:1789043021.703892:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043021.704043:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242464000 00000100:00100000:2.0:1789043021.704062:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242464000 00000100:00100000:2.0:1789043021.704149:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 46 00000100:00100000:2.0:1789043021.704165:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a77122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+52:11485:x1875947242464000:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:2.0:1789043021.704506:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a77122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+53:11485:x1875947242464000:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 345us (624us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1789043021.704567:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 46 00000100:00100000:3.0:1789043021.738348:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043021.738499:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242464256 00000100:00100000:1.0:1789043021.738567:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242464256 00000100:00100000:1.0:1789043021.738655:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 165 00000100:00100000:1.0:1789043021.738667:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a585b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+53:11488:x1875947242464256:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1789043021.738692:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043021.738727:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06a22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676b6f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.738805:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06a29 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.738820:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06a29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.738832:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06a29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.738845:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06a30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.738851:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06a30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.738858:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06a30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.738987:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06a37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.738996:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06a37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.739004:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06a37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789043021.739013:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789043021.739110:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06a29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.739129:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06a29 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.739135:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06a29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.739142:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687400 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043021.739146:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06a29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.739153:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06a29 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.739165:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa06a457d3100) 00010000:00010000:1.0:1789043021.739167:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043021.739172:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06a29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.739178:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06a29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.739192:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06a30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.739198:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06a30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.739203:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06a30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.739207:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043021.739217:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06a30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.739223:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06a30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.739230:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa06a44e19f00) 00010000:00010000:1.0:1789043021.739233:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043021.739236:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06a30 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.739242:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06a30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.739291:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06a22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b6f expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.739304:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06a37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b6f expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043021.739310:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19e00) 00010000:00010000:1.0:1789043021.739312:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789043021.739315:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41686e00, rc 0) 00000100:00100000:1.0:1789043021.739388:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a585b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+55:11488:x1875947242464256:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 723us (1128us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1789043021.739395:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 165 00000100:00100000:0.0:1789043021.752464:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043021.752597:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242464384 00000100:00100000:2.0:1789043021.752639:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242464384 00000100:00100000:2.0:1789043021.752742:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 13 00000100:00100000:2.0:1789043021.753154:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a77120000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+55:2349:x1875947242464384:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789043021.753176:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789043021.753211:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06a37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b6f expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043021.753238:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19e00) 00010000:00010000:2.0:1789043021.753245:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789043021.754178:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a77120000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+54:2349:x1875947242464384:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 1020us (1712us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043021.754192:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 13 00000100:00100000:0.0:1789043021.763623:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043021.763758:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242464512 00000100:00100000:3.0:1789043021.763768:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242464512 00000100:00100000:3.0:1789043021.763821:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 166 00000100:00100000:3.0:1789043021.763831:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a77122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+54:11488:x1875947242464512:12345-192.168.203.17@tcp:54:lfs.0 00010000:00010000:3.0:1789043021.764080:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06a45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043021.764098:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06a45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043021.764111:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06a45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043021.764136:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06a45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043021.764143:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06a45 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043021.764150:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06a45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043021.764169:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc29000 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789043021.764174:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06a45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043021.764183:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06a45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043021.764193:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19e00) 00010000:00010000:3.0:1789043021.764195:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789043021.764200:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06a45 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043021.764207:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06a45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043021.764440:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a77122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+54:11488:x1875947242464512:12345-192.168.203.17@tcp:54:lfs.0 Request processed in 608us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043021.764448:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 166 00000100:00100000:3.0:1789043021.773178:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043021.773408:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242464768 00000100:00100000:0.0:1789043021.773419:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242464768 00000100:00100000:0.0:1789043021.773487:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 47 00000100:00100000:0.0:1789043021.773498:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a585b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+54:11488:x1875947242464768:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:0.0:1789043021.773825:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a585b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+55:11488:x1875947242464768:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 327us (656us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1789043021.773833:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 47 00000100:00100000:0.0:1789043021.968198:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043021.968486:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242465024 00000100:00100000:2.0:1789043021.968500:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242465024 00000100:00100000:2.0:1789043021.968623:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 167 00000100:00100000:2.0:1789043021.968635:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a77121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+55:11506:x1875947242465024:12345-192.168.203.17@tcp:101:cat.0 00010000:00010000:2.0:1789043021.968667:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043021.968698:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06a4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676b76 expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043021.968837:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06a53 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043021.968855:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06a53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043021.968880:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06a53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789043021.968915:0:11703:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789043021.969215:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06a4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b76 expref: 58 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043021.969237:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06a53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b76 expref: 57 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043021.969246:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19e00) 00010000:00010000:2.0:1789043021.969249:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789043021.969253:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50978800, rc 0) 00000100:00100000:2.0:1789043021.969613:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a77121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+57:11506:x1875947242465024:12345-192.168.203.17@tcp:101:cat.0 Request processed in 977us (1427us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1789043021.969621:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 167 00000100:00100000:3.0:1789043022.014150:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043022.014391:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242465152 00000100:00100000:1.0:1789043022.014405:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242465152 00000100:00100000:1.0:1789043022.014610:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 168 00000100:00100000:1.0:1789043022.014625:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a585b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+57:11507:x1875947242465152:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1789043022.014679:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043022.014705:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06a61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676b7d expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.014795:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06a68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.014812:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06a68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.014826:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06a68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789043022.014881:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789043022.014887:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789043022.014908:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06a68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.014940:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06a61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b7d expref: 59 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.014961:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06a68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b7d expref: 58 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.014971:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa06a457d3100) 00010000:00010000:1.0:1789043022.014974:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789043022.014979:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41686200, rc 0) 00000100:00100000:1.0:1789043022.015043:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a585b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+58:11507:x1875947242465152:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 422us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043022.015050:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 168 00000100:00100000:0.0:1789043022.021114:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043022.021230:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242465536 00000100:00100000:2.0:1789043022.021244:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242465536 00000100:00100000:2.0:1789043022.021321:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 48 00000100:00100000:2.0:1789043022.021333:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a77120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+58:11507:x1875947242465536:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:2.0:1789043022.021814:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a77120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+59:11507:x1875947242465536:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 481us (711us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1789043022.021822:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 48 00000100:00100000:0.0:1789043022.032005:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043022.032117:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242465664 00000100:00100000:1.0:1789043022.032131:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242465664 00000100:00100000:1.0:1789043022.032233:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 14 00000100:00100000:1.0:1789043022.032245:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46f88850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+59:11507:x1875947242465664:12345-192.168.203.17@tcp:103:lfs.0 00010000:00010000:1.0:1789043022.032267:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789043022.032300:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c069f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b61 expref: 59 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.032330:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06a53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b76 expref: 58 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.032344:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06903 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b22 expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.032367:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19e00) 00010000:00010000:1.0:1789043022.032379:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789043022.032451:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46f88850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+56:11507:x1875947242465664:12345-192.168.203.17@tcp:103:lfs.0 Request processed in 208us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043022.032459:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 14 00000100:00100000:3.0:1789043022.038090:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043022.038267:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242465792 00000100:00100000:1.0:1789043022.038279:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242465792 00000100:00100000:1.0:1789043022.038378:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 169 00000100:00100000:1.0:1789043022.038390:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a585b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+56:11507:x1875947242465792:12345-192.168.203.17@tcp:58:lfs.0 00010000:00010000:1.0:1789043022.038575:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06a6f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.038598:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06a6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.038631:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06a6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789043022.039243:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1789043022.039387:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a585b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+56:11507:x1875947242465792:12345-192.168.203.17@tcp:58:lfs.0 Request processed in 995us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043022.039399:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 169 00000100:00100000:3.0:1789043022.066918:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789043022.066955:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f872680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267633280:0@lo:400:kworker.0 00000100:00100000:2.0:1789043022.067004:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f870380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875947267633152:0@lo:400:kworker.0 00000100:00100000:3.0:1789043022.067058:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043022.067116:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a772b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875947267633408:0@lo:400:kworker.0 00000100:00100000:3.0:1789043022.067139:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267632896:0@lo:400:kworker.0 00000100:00100000:0.0:1789043022.067166:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043022.067186:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043022.067246:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267632896 00000100:00100000:0.0:1789043022.067256:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267632896 00000100:00100000:3.0:1789043022.067262:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267633408 00000100:00100000:3.0:1789043022.067269:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267633408 00000100:00100000:0.0:1789043022.067327:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1789043022.067339:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46e78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3312:x1875947267632896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789043022.067402:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46e78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3312:x1875947267632896:12345-0@lo:400:kworker.0 Request processed in 65us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043022.067411:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1789043022.067461:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267633280 00000100:00100000:0.0:1789043022.067473:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267633280 00000100:00100000:0.0:1789043022.067505:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789043022.067541:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a585b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267633280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789043022.067577:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a585b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267633280:12345-0@lo:400:kworker.0 Request processed in 66us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043022.067583:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1789043022.067616:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789043022.067621:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789043022.067695:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267633024:0@lo:400:kworker.0 00000100:00100000:3.0:1789043022.067697:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789043022.067711:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a77120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875947267633408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789043022.067740:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043022.067769:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a772bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267633536:0@lo:400:kworker.0 00000100:00100000:3.0:1789043022.067789:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a77120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875947267633408:12345-0@lo:400:kworker.0 Request processed in 80us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043022.067801:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043022.067876:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043022.067928:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267633024 00000100:00100000:2.0:1789043022.067933:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267633024 00000100:00100000:3.0:1789043022.069113:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789043022.069123:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267633152 00000100:00100000:0.0:1789043022.069134:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267633152 00000100:00100000:3.0:1789043022.069160:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267633536 00000100:00100000:3.0:1789043022.069166:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267633536 00000100:00100000:0.0:1789043022.069199:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789043022.069211:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789043022.069213:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875947267633152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789043022.069224:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f85df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267633536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789043022.069296:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875947267633152:12345-0@lo:400:kworker.0 Request processed in 88us (1428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043022.069305:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789043022.069387:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f870380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875947267633152:0@lo:400:kworker.0 00000100:00100000:3.0:1789043022.069453:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f85df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267633536:12345-0@lo:400:kworker.0 Request processed in 232us (1652us total) trans 0 rc 0/0 00000100:00080000:1.0:1789043022.069668:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789043022.069676:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789043022.069716:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789043022.069742:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f85ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267633024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789043022.069780:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a772b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875947267633408:0@lo:400:kworker.0 00000100:00100000:3.0:1789043022.069818:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789043022.069822:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000100:00100000:3.0:1789043022.069860:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a772bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267633536:0@lo:400:kworker.0 00000100:00100000:3.0:1789043022.069907:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267633024:0@lo:400:kworker.0 00000100:00100000:2.0:1789043022.069928:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f85ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267633024:12345-0@lo:400:kworker.0 Request processed in 122us (2122us total) trans 0 rc 0/0 00000004:00080000:0.0:1789043022.069956:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1789043022.069985:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f872680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267633280:0@lo:400:kworker.0 00000100:00100000:0.0:1789043022.070007:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3312:1875947267632896:0@lo:400:kworker.0 00000100:00100000:2.0:1789043022.075048:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789043022.084625:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043022.085118:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242465920 00000100:00100000:1.0:1789043022.085133:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242465920 00000100:00100000:1.0:1789043022.085221:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 170 00000100:00100000:1.0:1789043022.085234:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a77121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+56:11509:x1875947242465920:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1789043022.085263:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043022.085291:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06a76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676b84 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.085387:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06a7d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.085405:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06a7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.085419:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06a7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.085436:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06a84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.085570:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06a84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.085578:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06a84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.085695:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06a8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.085704:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06a8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.085712:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06a8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789043022.085758:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789043022.085764:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789043022.085788:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06a8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.085801:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06a8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.085811:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06a7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.085818:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06a7d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.085825:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06a7d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.085841:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687400 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043022.085846:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06a7d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.085856:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06a7d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.085880:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa06a457d3100) 00010000:00010000:1.0:1789043022.085884:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043022.085890:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06a7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.085897:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06a7d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.085913:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06a84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.085919:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06a84 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.085924:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06a84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.085929:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686600 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043022.085932:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06a84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.085938:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06a84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.085956:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa06a44e19f00) 00010000:00010000:1.0:1789043022.085958:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043022.085961:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06a84 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.085967:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06a84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.086005:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06a76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b84 expref: 58 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.088107:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06a8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b84 expref: 57 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.088128:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19e00) 00010000:00010000:1.0:1789043022.088131:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789043022.088136:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41687e00, rc 0) 00000100:00100000:1.0:1789043022.088244:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a77121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+57:11509:x1875947242465920:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 3011us (3630us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043022.088255:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 170 00010000:00010000:1.0:1789043022.194758:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789043022.579290:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789043022.582279:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f85f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267633664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789043022.582932:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043022.583562:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267633664 00000100:00100000:1.0:1789043022.583573:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267633664 00000100:00100000:1.0:1789043022.583626:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789043022.583635:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a585b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267633664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789043022.583673:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789043022.583730:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a585b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267633664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043022.583745:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789043022.583797:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f85f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267633664:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1789043022.788005:0:12513:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789043022.788014:0:12513:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789043022.788046:0:12513:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789043022.788051:0:12513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1789043022.903166:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789043022.903176:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789043022.903212:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789043022.903218:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789043022.903352:0:11689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a585b3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1875947267633792:192.168.203.17@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789043022.903456:0:11689:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a52c9cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789043022.912299:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043022.912348:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242466048 00000100:00100000:0.0:1789043022.912356:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242466048 00000100:00100000:0.0:1789043022.912409:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 171 00000100:00100000:0.0:1789043022.912419:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a77121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+58:11521:x1875947242466048:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789043022.912604:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789043022.912708:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a77121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+58:11521:x1875947242466048:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 Request processed in 290us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043022.912715:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 171 00000100:00100000:1.0:1789043022.914815:0:11689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a585b3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1875947267633792:192.168.203.17@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789043022.918239:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043022.918339:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242466176 00000100:00100000:3.0:1789043022.918350:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242466176 00000100:00100000:3.0:1789043022.918410:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 172 00000100:00100000:3.0:1789043022.918420:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f85f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+57:11521:x1875947242466176:12345-192.168.203.17@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789043022.918499:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06a92 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.918553:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06a92 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.918567:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06a92 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.918624:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06a99 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.918632:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06a99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.918639:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06a99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.918671:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06aa0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.918679:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.918686:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789043022.918741:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789043022.918746:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789043022.918759:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.918769:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06a92 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.918776:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06a92 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.918781:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06a92 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.918787:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc28400 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789043022.918792:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06a92 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.918799:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06a92 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.918810:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa06a44e19600) 00010000:00010000:3.0:1789043022.918813:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789043022.918817:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06a92 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.918822:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06a92 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.918836:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06a99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.918850:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06a99 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.918856:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06a99 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.918872:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc29000 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789043022.918875:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06a99 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.918880:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06a99 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.918888:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffffa06a55d80200) 00010000:00010000:3.0:1789043022.918891:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789043022.918893:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06a99 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.918898:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06a99 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.918912:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.918918:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06aa0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.918923:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.918928:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc28800 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789043022.918937:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.918943:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06aa0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.918951:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19e00) 00010000:00010000:3.0:1789043022.918953:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789043022.918956:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06aa0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.918962:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06aa0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043022.919030:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f85f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+57:11521:x1875947242466176:12345-192.168.203.17@tcp:34:lhsmtool_posix.0 Request processed in 610us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043022.919038:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 172 00000100:00100000:0.0:1789043022.927988:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043022.928409:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242466432 00000100:00100000:1.0:1789043022.928419:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242466432 00000100:00100000:1.0:1789043022.939753:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 173 00000100:00100000:1.0:1789043022.939769:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a77120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+57:11521:x1875947242466432:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789043022.939791:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043022.939811:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06aa7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676b8b expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.939917:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06aae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.939932:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06aae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.939943:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06aae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789043022.939955:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789043022.940045:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06aae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.940052:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06aae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.940072:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06aae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.940077:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687400 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043022.940081:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06aae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.940088:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06aae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.940099:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19e00) 00010000:00010000:1.0:1789043022.940102:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789043022.940107:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06aae lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.940114:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06aae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.940154:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06aa7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b8b expref: 59 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.940164:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa06a44e19600) 00010000:00010000:1.0:1789043022.940166:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789043022.940170:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06aa7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b8b expref: 59 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.940179:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41686e00, rc 0) 00000100:00100000:1.0:1789043022.940238:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a77120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+58:11521:x1875947242466432:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 474us (12260us total) trans 4294967457 rc 301/301 00000100:00100000:1.0:1789043022.940253:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 173 00000100:00100000:2.0:1789043022.947908:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043022.948428:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242466560 00000100:00100000:3.0:1789043022.948453:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242466560 00000100:00100000:3.0:1789043022.948548:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 174 00000100:00100000:3.0:1789043022.948560:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+58:11521:x1875947242466560:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789043022.948600:0:11703:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789043022.948715:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+58:11521:x1875947242466560:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 Request processed in 157us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043022.948722:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 174 00000100:00100000:2.0:1789043022.964022:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043022.964352:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242466816 00000100:00100000:3.0:1789043022.964362:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242466816 00000100:00100000:3.0:1789043022.964551:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 175 00000100:00100000:3.0:1789043022.964563:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+58:11521:x1875947242466816:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789043022.964595:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789043022.964598:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789043022.964625:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06a68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b7d expref: 58 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.964643:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa06a457d3100) 00010000:00010000:3.0:1789043022.964648:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789043022.964662:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06abc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676b92 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789043022.965069:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1789043022.965266:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06ac3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.965280:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.965291:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.965341:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06abc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b92 expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.965357:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06ac3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b92 expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.965364:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa06a55d80200) 00010000:00010000:3.0:1789043022.965367:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789043022.965376:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc29000, rc 0) 00000100:00100000:3.0:1789043022.965449:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+59:11521:x1875947242466816:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 875us (1422us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1789043022.965458:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 175 00000100:00100000:3.0:1789043022.978965:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043022.978999:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242467072 00000100:00100000:3.0:1789043022.979009:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242467072 00000100:00100000:3.0:1789043022.979055:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 176 00000100:00100000:3.0:1789043022.979065:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a585b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+59:11521:x1875947242467072:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789043022.979123:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789043022.979154:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06ac3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b92 expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.979174:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa06a55d80200) 00010000:00010000:3.0:1789043022.979187:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789043022.979208:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06ad1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.979221:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06ad1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.979230:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06ad1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.979244:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06ad8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xb9d4931a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.979251:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06ad8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb9d4931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.979269:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06ad8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb9d4931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.979349:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06ad1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.979356:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06ad1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.979363:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06ad1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.979369:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc28400 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789043022.979373:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06ad1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.979380:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06ad1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.979388:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa06a457d3100) 00010000:00010000:3.0:1789043022.979390:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789043022.979394:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06ad1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.979399:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06ad1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.979407:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06ad8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb9d4931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.979413:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06ad8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb9d4931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.979424:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06ad8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb9d4931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.979442:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc28200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789043022.979446:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06ad8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb9d4931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.979453:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06ad8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb9d4931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.979461:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xb9d4931a (ffffa06a55d80100) 00010000:00010000:3.0:1789043022.979463:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789043022.979466:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06ad8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb9d4931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043022.979472:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06ad8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb9d4931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043022.979572:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a585b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+58:11521:x1875947242467072:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 Request processed in 507us (615us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789043022.979579:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 176 00000100:00100000:3.0:1789043022.985310:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043022.985399:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242467200 00000100:00100000:2.0:1789043022.985409:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242467200 00000100:00100000:2.0:1789043022.985657:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 177 00000100:00100000:2.0:1789043022.985668:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a585b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+58:11521:x1875947242467200:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789043022.985688:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043022.985712:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06adf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676b99 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043022.985751:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c06ae6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043022.985764:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c06ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043022.985776:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c06ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043022.985889:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06adf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b99 expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043022.985904:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c06ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b99 expref: 59 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043022.985922:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa06a457d3c00) 00010000:00010000:2.0:1789043022.985925:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789043022.985929:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50979600, rc 0) 00000100:00100000:2.0:1789043022.986028:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a585b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+59:11521:x1875947242467200:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 362us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043022.986035:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 177 00000100:00100000:2.0:1789043022.989751:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043022.990224:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242467456 00000100:00100000:0.0:1789043022.990235:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242467456 00000100:00100000:0.0:1789043022.990294:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 178 00000100:00100000:0.0:1789043022.990386:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+59:11521:x1875947242467456:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789043022.990465:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06aed lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043022.990482:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06aed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043022.990494:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06aed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789043022.990815:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1789043022.990825:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 365947310315ns, next at 366947308542ns, rc = 0 00000004:00010000:0.0:1789043022.990931:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000030047749 reply state 000000000473b015 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06aed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043022.990941:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789043022.991035:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+61:11521:x1875947242467456:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 Request processed in 653us (1291us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1789043022.991042:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 178 00010000:00010000:1.0:1789043022.993473:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06aed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.993487:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06aed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.993495:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06aed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.993501:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a40031a00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043022.993505:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06aed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.993544:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06aed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.993561:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa06a457d3c00) 00010000:00010000:1.0:1789043022.993564:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789043022.993570:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06aed lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043022.993577:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06aed lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043022.995605:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043023.001488:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242467584 00000100:00100000:0.0:1789043023.001504:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242467584 00000100:00100000:0.0:1789043023.001615:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 179 00000100:00100000:0.0:1789043023.001626:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+60:11521:x1875947242467584:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789043023.001652:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789043023.001674:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06af4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676ba0 expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.001735:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06af4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ba0 expref: 61 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.001751:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06af4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ba0 expref: 61 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.001772:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa06a457d3c00) 00010000:00010000:0.0:1789043023.001775:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789043023.001779:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a40031600, rc 0) 00000100:00100000:0.0:1789043023.001842:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+61:11521:x1875947242467584:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 219us (6246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043023.001849:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 179 00000100:00080000:1.0:1789043023.001933:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789043023.007065:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043023.007143:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242467712 00000100:00100000:0.0:1789043023.007173:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242467712 00000100:00100000:0.0:1789043023.007253:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 50 00000100:00100000:0.0:1789043023.007263:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2351:x1875947242467712:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1789043023.007297:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789043023.007639:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2351:x1875947242467712:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 Request processed in 376us (595us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1789043023.007648:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 50 00000100:00100000:3.0:1789043023.019128:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043023.020106:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242467968 00000100:00100000:2.0:1789043023.020117:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242467968 00000100:00100000:2.0:1789043023.020178:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 49 00000100:00100000:2.0:1789043023.020188:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+61:11521:x1875947242467968:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789043023.020419:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+62:11521:x1875947242467968:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 Request processed in 232us (1300us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1789043023.020427:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 49 00000100:00100000:2.0:1789043023.029370:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043023.030505:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242468224 00000100:00100000:1.0:1789043023.030556:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242468224 00000100:00100000:1.0:1789043023.030628:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 180 00000100:00100000:1.0:1789043023.030642:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+62:11521:x1875947242468224:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789043023.030768:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+62:11521:x1875947242468224:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 Request processed in 130us (1409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043023.030776:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 180 00000100:00100000:2.0:1789043023.038265:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043023.038319:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242468352 00000100:00100000:0.0:1789043023.038329:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242468352 00000100:00100000:0.0:1789043023.038390:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 181 00000100:00100000:0.0:1789043023.038401:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+62:11521:x1875947242468352:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789043023.038424:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789043023.038446:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06afb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676ba7 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.038531:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06b02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.038546:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06b02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.038558:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06b02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789043023.038593:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789043023.038612:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06b02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.038638:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06afb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ba7 expref: 64 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.038673:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06b02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ba7 expref: 63 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.038681:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa06a457d3c00) 00010000:00010000:0.0:1789043023.038684:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789043023.038687:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a40031000, rc 0) 00000100:00100000:0.0:1789043023.038749:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+63:11521:x1875947242468352:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 350us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043023.038756:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 181 00000100:00100000:2.0:1789043023.047915:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043023.048052:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242468480 00000100:00100000:0.0:1789043023.048062:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242468480 00000100:00100000:0.0:1789043023.048119:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 51 00000100:00100000:0.0:1789043023.048129:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2352:x1875947242468480:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789043023.048147:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789043023.048178:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004dc47374/0x99260d7389c06b09 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676bae expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789043023.048206:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa2a14f, blocks: 0x1 00010000:00010000:0.0:1789043023.048226:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=366s v=(0 0) 00010000:00010000:0.0:1789043023.048231:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043023.048240:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dc47374/0x99260d7389c06b09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bae expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.048261:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004dc47374/0x99260d7389c06b09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bae expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.048293:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a413a0600, rc 0) 00000100:00100000:0.0:1789043023.048353:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:2352:x1875947242468480:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 225us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043023.048360:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 51 00000100:00100000:2.0:1789043023.055214:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043023.055265:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043023.055307:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043023.055443:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242468608 00000100:00100000:1.0:1789043023.055453:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242468608 00000100:00100000:1.0:1789043023.055544:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 298 00000100:00100000:1.0:1789043023.055556:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2350:x1875947242468608:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1789043023.055626:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2350:x1875947242468608:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 73us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043023.055633:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 298 00000100:00100000:3.0:1789043023.055721:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242468864 00000100:00100000:3.0:1789043023.055727:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242468864 00000100:00100000:0.0:1789043023.055754:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242468736 00000100:00100000:0.0:1789043023.055760:0:8215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242468736 00000100:00100000:0.0:1789043023.055807:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 94 00000100:00100000:0.0:1789043023.055817:0:8215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2350:x1875947242468736:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1789043023.055854:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 159 00000100:00080000:1.0:1789043023.055869:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789043023.055870:0:8215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2350:x1875947242468736:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 44us (655us total) trans 0 rc 0/0 00000100:00080000:1.0:1789043023.055874:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789043023.055876:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2350:x1875947242468864:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1789043023.055882:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 94 00000100:00100000:3.0:1789043023.057511:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2350:x1875947242468864:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 1628us (2191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043023.057551:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 159 00000100:00100000:1.0:1789043023.059925:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043023.060462:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242469120 00000100:00100000:3.0:1789043023.060476:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242469120 00000100:00100000:3.0:1789043023.060570:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 182 00000100:00100000:3.0:1789043023.060582:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f85e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+63:11521:x1875947242469120:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789043023.060700:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f85e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+63:11521:x1875947242469120:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 Request processed in 121us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043023.065035:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 182 00000100:00100000:2.0:1789043023.066626:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043023.066881:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242469248 00000100:00100000:3.0:1789043023.066892:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242469248 00000100:00100000:3.0:1789043023.066952:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 52 00000100:00100000:3.0:1789043023.066963:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:11521:x1875947242469248:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789043023.066982:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789043023.067000:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cc7579a/0x99260d7389c06b10 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676bb5 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043023.067032:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004dc47374/0x99260d7389c06b09 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bae expref: 9 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043023.067042:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789043023.067047:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789043023.067052:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cc7579a/0x99260d7389c06b10 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bb5 expref: 9 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043023.067117:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004dc47374/0x99260d7389c06b09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bae expref: 9 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043023.067131:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004dc47374/0x99260d7389c06b09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bae expref: 9 pid: 6691 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043023.067161:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52461880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6691:1875947267633920:192.168.203.17@tcp:104: 00000100:00100000:3.0:1789043023.067265:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a52c9ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789043023.075366:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043023.075496:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52461880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6691:1875947267633920:192.168.203.17@tcp:104: 00010000:00010000:3.0:1789043023.075559:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001cc7579a/0x99260d7389c06b10 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bb5 expref: 9 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043023.075580:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc28200, rc 0) 00000100:00100000:3.0:1789043023.075639:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+9:11521:x1875947242469248:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 8677us (9019us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043023.075648:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 52 00000100:00100000:0.0:1789043023.075753:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242469376 00000100:00100000:0.0:1789043023.075760:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242469376 00010000:00010000:0.0:1789043023.075792:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004dc47374/0x99260d7389c06b09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bae expref: 9 pid: 6691 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043023.075820:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 69 00000100:00100000:0.0:1789043023.075828:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+9:2352:x1875947242469376:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789043023.075840:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789043023.075873:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004dc47374/0x99260d7389c06b09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bae expref: 9 pid: 6691 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.075885:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004dc47374/0x99260d7389c06b09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bae expref: 9 pid: 6691 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.075922:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004dc47374/0x99260d7389c06b09 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bae expref: 9 pid: 6691 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.075937:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043023.075941:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043023.075950:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001cc7579a/0x99260d7389c06b10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bb5 expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.075961:0:8457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cc7579a/0x99260d7389c06b10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bb5 expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.075997:0:8457:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001cc7579a/0x99260d7389c06b10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bb5 expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043023.076011:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f873100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8457:1875947267634048:192.168.203.17@tcp:105: 00000100:00100000:0.0:1789043023.076082:0:8457:0:(client.c:2716:ptlrpc_set_wait()) set ffffa069435559c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789043023.084828:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043023.084971:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f873100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8457:1875947267634048:192.168.203.17@tcp:105: 00010000:00010000:0.0:1789043023.084991:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789043023.085034:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:2352:x1875947242469376:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 9207us (9678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043023.085045:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 69 00000100:00100000:3.0:1789043023.085191:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242469504 00000100:00100000:3.0:1789043023.085200:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242469504 00002000:00100000:3.0:1789043023.085254:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffffa06a772baa00 x1875947242469504/t0(0) o4->3fb32839-ebfd-4c0f-90e4-f036c86704df@192.168.203.17@tcp:319/0 lens 504/0 e 0 to 0 dl 1789043034 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789043023.085265:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa06a772baa00 with x1875947242469504 ext(0->8) 00002000:00010000:3.0:1789043023.085272:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa06a772baa00 00000100:00100000:3.0:1789043023.085304:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 4 00000100:00100000:3.0:1789043023.085326:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:2349:x1875947242469504:12345-192.168.203.17@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789043023.085885:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+10:2349:x1875947242469504:12345-192.168.203.17@tcp:4:lhsmtool_posix.0 Request processed in 557us (1064us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1789043023.085893:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 4 00002000:00100000:0.0:1789043023.085906:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffffa06a772baa00 x1875947242469504/t4294967314(0) o4->3fb32839-ebfd-4c0f-90e4-f036c86704df@192.168.203.17@tcp:319/0 lens 504/448 e 0 to 0 dl 1789043034 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789043023.085915:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa06a772baa00 with x1875947242469504 ext(0->8) 00002000:00010000:0.0:1789043023.085919:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa06a772baa00 00000100:00100000:2.0:1789043023.089150:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043023.089248:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242469632 00000100:00100000:3.0:1789043023.089259:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242469632 00000100:00100000:3.0:1789043023.089322:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 183 00000100:00100000:3.0:1789043023.089333:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+63:11521:x1875947242469632:12345-192.168.203.17@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789043023.148783:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:0.0:1789043023.148798:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000100:00100000:3.0:1789043023.149092:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+62:11521:x1875947242469632:12345-192.168.203.17@tcp:44:lhsmtool_posix.0 Request processed in 59755us (59945us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043023.149102:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 183 00000001:00080000:1.0:1789043023.150050:0:12528:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:1.0:1789043023.150070:0:12528:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa06a41359d80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1789043023.150075:0:12528:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa06a4636c300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa06a41359240 00000020:00080000:1.0:1789043023.150077:0:12528:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa06a4636c800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa06a77312000 00000020:00080000:1.0:1789043023.150129:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1789043023.150330:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1789043023.151074:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a772ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267634176:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789043023.151138:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043023.157332:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267634176 00000100:00100000:2.0:1789043023.157354:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267634176 00000100:00100000:2.0:1789043023.157433:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789043023.157444:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267634176:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789043023.157902:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789043023.157907:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789043023 00002000:00010000:2.0:1789043023.157909:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789043023.157912:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789043023 -> 1789043023 00002000:00010000:2.0:1789043023.157914:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789043023.157982:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1875947267634176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 540us (6843us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789043023.157989:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000004:00080000:3.0:1789043023.158215:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa06a772ba680/2, rc 0, transno 4294967315 00000100:00100000:3.0:1789043023.158223:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a772ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267634176:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789043023.158506:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000004:00080000:0.0:1789043023.159117:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:0.0:1789043023.159362:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267634304:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789043023.159406:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043023.161054:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242469760 00000100:00100000:3.0:1789043023.161066:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242469760 00000100:00100000:3.0:1789043023.161171:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 54 00000100:00100000:3.0:1789043023.161181:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+10:2350:x1875947242469760:12345-192.168.203.17@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789043023.169695:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267634304 00000100:00100000:2.0:1789043023.169710:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267634304 00000100:00100000:2.0:1789043023.170005:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789043023.170016:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267634304:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789043023.170049:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:2.0:1789043023.170083:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa2a14c, atime: 0x6aa2a14c, ctime: 0x6aa2a14c, blocks: 0xb 00010000:00010000:2.0:1789043023.170092:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091dc7aae/0x99260d7389c06b17 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043023.170109:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=366s v=(0 0) 00010000:00010000:2.0:1789043023.170114:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789043023.170121:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091dc7aae/0x99260d7389c06b17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043023.170138:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091dc7aae/0x99260d7389c06b17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043023.170158:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091dc7aae/0x99260d7389c06b17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043023.170167:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091dc7aae/0x99260d7389c06b17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043023.170192:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789043023.170202:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789043023.170210:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091dc7aae/0x99260d7389c06b17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043023.170221:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979800 already unused, calling callback (ffffffffc1470760) 00010000:00010000:3.0:1789043023.170226:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091dc7aae/0x99260d7389c06b17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043023.170237:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091dc7aae/0x99260d7389c06b17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043023.170263:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091dc7aae/0x99260d7389c06b17 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043023.170270:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091dc7aae/0x99260d7389c06b17 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043023.170288:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043023.170290:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043023.170292:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789043023.170869:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1875947267634304:12345-0@lo:6:osp-syn-0-0.0 Request processed in 841us (11447us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789043023.170878:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00080000:1.0:1789043023.171243:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa06a7f85ed80/2, rc 0, transno 4294967307 00000100:00100000:1.0:1789043023.171252:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267634304:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789043023.222834:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789043023.246134:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:3.0:1789043023.246325:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2350:x1875947242469760:12345-192.168.203.17@tcp:16:lhsmtool_posix.0 Request processed in 85135us (87811us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043023.246337:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 54 00000001:00080000:3.0:1789043023.246370:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1789043023.250318:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043023.250635:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242470016 00000100:00100000:2.0:1789043023.250645:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242470016 00000100:00100000:2.0:1789043023.250825:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 184 00000100:00100000:2.0:1789043023.250837:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+18:11521:x1875947242470016:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789043023.250902:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789043023.250930:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06b02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ba7 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043023.250950:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa06a457d3c00) 00010000:00010000:2.0:1789043023.250955:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789043023.250987:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06b1e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043023.251002:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06b1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043023.251030:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06b1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789043023.251283:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f1d5e57 reply state 000000001473851d transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06b1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043023.251294:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789043023.251642:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+19:11521:x1875947242470016:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 Request processed in 805us (1334us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1789043023.251722:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 184 00010000:00010000:3.0:1789043023.255161:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06b1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043023.255180:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06b1e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043023.255187:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06b1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043023.255193:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979400 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789043023.255197:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06b1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043023.255223:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06b1e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043023.255238:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa06a457d3c00) 00010000:00010000:3.0:1789043023.255241:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789043023.255246:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06b1e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043023.255252:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06b1e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043023.255952:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043023.256190:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242470144 00000100:00100000:0.0:1789043023.256202:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242470144 00000100:00100000:0.0:1789043023.256261:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 56 00000100:00100000:0.0:1789043023.256270:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2350:x1875947242470144:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789043023.256565:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1789043023.256569:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789043023 -> 1789043021 00002000:00010000:0.0:1789043023.256571:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789043020 00002000:00010000:0.0:1789043023.256574:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789043023 -> 1789043021 00002000:00010000:0.0:1789043023.256576:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789043023.256629:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:2350:x1875947242470144:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 Request processed in 359us (683us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789043023.256636:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 56 00000100:00100000:0.0:1789043023.259821:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043023.260103:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242470400 00000100:00100000:1.0:1789043023.260113:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242470400 00000100:00100000:1.0:1789043023.260186:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 185 00000100:00100000:1.0:1789043023.260197:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+18:11521:x1875947242470400:12345-192.168.203.17@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789043023.260281:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06b25 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043023.260299:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c06ae6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b99 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043023.260308:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06b25 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043023.260360:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c06ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b99 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043023.260374:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c06ae6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b99 expref: 18 pid: 5847 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043023.260389:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a453a6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875947267634432:192.168.203.17@tcp:104: 00000100:00100000:1.0:1789043023.260489:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7f8ce900 going to sleep for 11 seconds 00000100:00100000:3.0:1789043023.263726:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a453a6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875947267634432:192.168.203.17@tcp:104: 00010000:00010000:3.0:1789043023.263760:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06b25 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043023.264734:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043023.264988:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242470528 00000100:00100000:2.0:1789043023.264999:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242470528 00010000:00010000:2.0:1789043023.265048:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c06ae6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b99 expref: 19 pid: 5847 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043023.265090:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 70 00000100:00100000:2.0:1789043023.265100:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f871c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+19:2351:x1875947242470528:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789043023.265116:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789043023.265122:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c06ae6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b99 expref: 19 pid: 5847 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043023.265136:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c06ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b99 expref: 19 pid: 5847 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043023.265159:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c06ae6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b99 expref: 19 pid: 5847 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043023.265193:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa06a457d3c00) 00010000:00010000:2.0:1789043023.265199:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06b25 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043023.265208:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06b25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043023.265215:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06b25 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043023.265239:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789043023.265305:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f871c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+18:2351:x1875947242470528:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 206us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043023.265318:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 70 00010000:00010000:3.0:1789043023.266629:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06b25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043023.266642:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06b25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043023.266680:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06b25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043023.266687:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06b25 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043023.266694:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06b25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043023.266716:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686e00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789043023.266720:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06b25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043023.266729:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06b25 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043023.266743:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa06a457d3c00) 00010000:00010000:3.0:1789043023.266745:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789043023.266749:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06b25 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043023.266755:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06b25 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043023.266829:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+17:11521:x1875947242470400:12345-192.168.203.17@tcp:55:lhsmtool_posix.0 Request processed in 6631us (7015us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789043023.266838:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 185 00000100:00100000:0.0:1789043023.273166:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043023.273285:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242470656 00000100:00100000:1.0:1789043023.273295:0:8215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242470656 00000100:00100000:1.0:1789043023.273982:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 57 00000100:00100000:1.0:1789043023.273995:0:8215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f870000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:2352:x1875947242470656:12345-192.168.203.17@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789043023.274038:0:8215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000001d56710/0x99260d7389c06b2c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043023.274057:0:8215:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001cc7579a/0x99260d7389c06b10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bb5 expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043023.274084:0:8215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789043023.274088:0:8215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789043023.274093:0:8215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001d56710/0x99260d7389c06b2c lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043023.274128:0:8215:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001cc7579a/0x99260d7389c06b10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bb5 expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043023.274142:0:8215:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001cc7579a/0x99260d7389c06b10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bb5 expref: 8 pid: 6691 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043023.274156:0:8215:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a453a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8215:1875947267634560:192.168.203.17@tcp:104: 00000100:00100000:1.0:1789043023.274237:0:8215:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7f8ce0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789043023.279079:0:8215:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a453a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8215:1875947267634560:192.168.203.17@tcp:104: 00010000:00010000:0.0:1789043023.279122:0:8215:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000001d56710/0x99260d7389c06b2c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043023.280016:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043023.280764:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242470784 00000100:00100000:2.0:1789043023.280773:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242470784 00010000:00010000:2.0:1789043023.280809:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001cc7579a/0x99260d7389c06b10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bb5 expref: 9 pid: 6691 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043023.280852:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 71 00000100:00100000:2.0:1789043023.280873:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f870380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+9:2352:x1875947242470784:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789043023.280888:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789043023.280910:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001cc7579a/0x99260d7389c06b10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bb5 expref: 9 pid: 6691 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043023.280924:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001cc7579a/0x99260d7389c06b10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bb5 expref: 9 pid: 6691 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043023.280964:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cc7579a/0x99260d7389c06b10 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bb5 expref: 9 pid: 6691 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043023.280980:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789043023.280985:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789043023.280990:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000001d56710/0x99260d7389c06b2c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043023.281000:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001d56710/0x99260d7389c06b2c lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043023.281032:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789043023.281213:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f870380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:2352:x1875947242470784:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 341us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043023.281222:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 71 00010000:00010000:0.0:1789043023.281290:0:8215:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000001d56710/0x99260d7389c06b2c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.281299:0:8215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001d56710/0x99260d7389c06b2c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.281323:0:8215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000001d56710/0x99260d7389c06b2c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.281342:0:8215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001d56710/0x99260d7389c06b2c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.281349:0:8215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001d56710/0x99260d7389c06b2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.281356:0:8215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686600 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789043023.281361:0:8215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001d56710/0x99260d7389c06b2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.281370:0:8215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001d56710/0x99260d7389c06b2c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.281384:0:8215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001d56710/0x99260d7389c06b2c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.281404:0:8215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001d56710/0x99260d7389c06b2c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043023.281465:0:8215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f870000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2352:x1875947242470656:12345-192.168.203.17@tcp:1:lhsmtool_posix.0 Request processed in 7474us (8307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043023.281473:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 57 00000100:00100000:3.0:1789043023.285087:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043023.285148:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242471040 00000100:00100000:0.0:1789043023.285158:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242471040 00000100:00100000:0.0:1789043023.285215:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 186 00000100:00100000:0.0:1789043023.285227:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+17:11521:x1875947242471040:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789043023.285310:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c06b33 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.285328:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c06b33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.285352:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c06b33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.285645:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06b3a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.285663:0:11703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06af4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ba0 expref: 18 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.285672:0:11703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06b3a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.285716:0:11703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06af4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ba0 expref: 18 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.285730:0:11703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06af4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ba0 expref: 18 pid: 11703 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043023.285744:0:11703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a763caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11703:1875947267634688:192.168.203.17@tcp:104: 00000100:00100000:0.0:1789043023.286833:0:11703:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a52c30c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789043023.290416:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043023.290534:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242471168 00000100:00100000:1.0:1789043023.290544:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242471168 00010000:00010000:1.0:1789043023.290591:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06af4 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ba0 expref: 19 pid: 11703 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043023.290627:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 72 00000100:00100000:1.0:1789043023.290637:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+19:2351:x1875947242471168:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789043023.290663:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789043023.290670:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06af4 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ba0 expref: 19 pid: 11703 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043023.290683:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06af4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ba0 expref: 19 pid: 11703 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043023.290718:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa06a457d3c00) 00010000:00010000:1.0:1789043023.290723:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06b3a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043023.290732:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06b3a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043023.290739:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06b3a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043023.290758:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789043023.290803:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+19:2351:x1875947242471168:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 167us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043023.290810:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 72 00010000:00010000:0.0:1789043023.293175:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06af4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ba0 expref: 18 pid: 11703 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043023.293199:0:11703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a763caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11703:1875947267634688:192.168.203.17@tcp:104: 00010000:00010000:0.0:1789043023.293224:0:11703:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06b3a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043023.293425:0:11703:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06b3a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043023.293432:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06b3a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789043023.293851:0:11703:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1789043023.294015:0:11703:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1789043023.294072:0:11703:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1789043023.294160:0:11703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a453a6680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11703:1875947267634816:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789043023.294222:0:11703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043023.294316:0:11703:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7f8ce840 going to sleep for 11 seconds 00000100:00100000:3.0:1789043023.294932:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267634816 00000100:00100000:3.0:1789043023.294941:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267634816 00000100:00100000:3.0:1789043023.295024:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789043023.295034:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75ede300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11703:x1875947267634816:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1789043023.295134:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75ede300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11703:x1875947267634816:12345-0@lo:1000:mdt00_004.0 Request processed in 101us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043023.295142:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789043023.295197:0:11703:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1789043023.295203:0:11703:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa06a772ba680, transno 4294967315 00000100:00100000:0.0:1789043023.295223:0:11703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a453a6680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11703:1875947267634816:0@lo:1000:mdt00_004.0 00000001:00080000:0.0:1789043023.295811:0:11703:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1789043023.295890:0:11703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a763caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11703:1875947267634944:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1789043023.295926:0:11703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043023.295955:0:11703:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a52c30a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789043023.296098:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267634944 00000100:00100000:1.0:1789043023.296104:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267634944 00000100:00100000:1.0:1789043023.296144:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789043023.296161:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a453a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:11703:x1875947267634944:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789043023.296322:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a453a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:11703:x1875947267634944:12345-0@lo:1000:mdt00_004.0 Request processed in 163us (394us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1789043023.296338:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789043023.296482:0:11703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a763caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11703:1875947267634944:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1789043023.296544:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06b3a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.296566:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06b3a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.296574:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06b3a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.296580:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a413a0e00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789043023.296584:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06b3a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.296592:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06b3a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.296606:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa06a457d3c00) 00010000:00010000:0.0:1789043023.296609:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789043023.296614:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06b3a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.296620:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06b3a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.296821:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06a6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.296829:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06a6f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.296834:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06a6f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.296838:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687000 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789043023.296847:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06a6f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.296854:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06a6f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.296874:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19e00) 00010000:00010000:0.0:1789043023.296876:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789043023.296879:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06a6f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.296884:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06a6f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.296907:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c06b41 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.296921:0:11703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06a8b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b84 expref: 21 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.296930:0:11703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c06b41 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.296968:0:11703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06a8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b84 expref: 21 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.296981:0:11703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06a8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b84 expref: 21 pid: 6714 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043023.296993:0:11703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6ff0d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11703:1875947267635072:192.168.203.17@tcp:104: 00000100:00100000:0.0:1789043023.297092:0:11703:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a52c30a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789043023.300953:0:11703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6ff0d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11703:1875947267635072:192.168.203.17@tcp:104: 00010000:00010000:0.0:1789043023.300984:0:11703:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c06b41 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043023.302349:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043023.302583:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242471296 00000100:00100000:3.0:1789043023.302605:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242471296 00010000:00010000:3.0:1789043023.302642:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06a8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b84 expref: 22 pid: 6714 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043023.302687:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 73 00000100:00100000:3.0:1789043023.302697:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a027800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+22:2352:x1875947242471296:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789043023.302711:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789043023.302717:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06a8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b84 expref: 22 pid: 6714 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043023.302730:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06a8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b84 expref: 22 pid: 6714 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043023.302752:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06a8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676b84 expref: 22 pid: 6714 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043023.302771:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19e00) 00010000:00010000:3.0:1789043023.302776:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c06b41 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043023.302784:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c06b41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043023.302791:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c06b41 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043023.302818:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789043023.302892:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a027800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+21:2352:x1875947242471296:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 196us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043023.302910:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 73 00010000:00010000:0.0:1789043023.303104:0:11703:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c06b41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.303114:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c06b41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.303124:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c06b41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.303130:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c06b41 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.303136:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c06b41 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.303142:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a413a0600 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789043023.303146:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c06b41 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.303154:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c06b41 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.303163:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19e00) 00010000:00010000:0.0:1789043023.303165:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789043023.303169:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c06b41 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.303174:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c06b41 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.303193:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c06b33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.303198:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c06b33 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.303203:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c06b33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.303207:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a413a0800 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789043023.303210:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c06b33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.303216:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c06b33 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.303225:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19e00) 00010000:00010000:0.0:1789043023.303228:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789043023.303231:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c06b33 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043023.303237:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c06b33 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043023.303452:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+20:11521:x1875947242471040:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 Request processed in 18226us (18372us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1789043023.303460:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 186 00000020:00080000:0.0:1789043023.303463:0:11703:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789043023.303616:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789043023.303621:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789043023.304107:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1789043023.304114:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789043023.307634:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043023.307831:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242471552 00000100:00100000:1.0:1789043023.307840:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242471552 00000100:00100000:1.0:1789043023.307918:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 50 00000100:00100000:1.0:1789043023.307930:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5ffdf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+20:11521:x1875947242471552:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789043023.308610:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789043023.309236:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1789043023.309294:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06b48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043023.309310:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06b48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043023.309843:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06b48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043023.309864:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06b48 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043023.309872:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06b48 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043023.309984:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06b48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043023.310044:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789043023.310147:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5ffdf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+22:11521:x1875947242471552:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 Request processed in 2216us (2517us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1789043023.310155:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 50 00000020:00080000:1.0:1789043023.310160:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789043023.311938:0:11175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789043023.311951:0:11175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06b48 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043023.311962:0:11175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687200 already unused, calling callback (ffffffffc1470760) 00010000:00010000:2.0:1789043023.311966:0:11175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06b48 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043023.311976:0:11175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06b48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043023.311992:0:11175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa06a44e19900) 00010000:00010000:2.0:1789043023.312010:0:11175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789043023.312016:0:11175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06b48 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043023.312021:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06b48 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043023.312042:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043023.312044:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043023.312045:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789043024.116115:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267635200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789043024.116189:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043024.116323:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267635200 00000100:00100000:3.0:1789043024.116331:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267635200 00000100:00100000:3.0:1789043024.116400:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789043024.116410:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6ff0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875947267635200:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789043024.116498:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1789043024.116673:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789043024.116719:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6ff0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875947267635200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 311us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043024.116727:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789043024.116806:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267635200:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789043024.249102:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789043024.736050:0:12568:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789043024.736063:0:12568:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789043024.736107:0:12568:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789043024.736115:0:12568:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789043024.861467:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043024.862360:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242471808 00000100:00100000:3.0:1789043024.862376:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242471808 00000100:00100000:3.0:1789043024.862460:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 187 00000100:00100000:3.0:1789043024.862472:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+22:11538:x1875947242471808:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:3.0:1789043024.862504:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789043024.862549:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06b4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676bbc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043024.862684:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06b56 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043024.862702:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06b56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043024.862716:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06b56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789043024.862753:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789043024.862921:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06b4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bbc expref: 25 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043024.862944:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06b56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bbc expref: 24 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043024.862953:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa06a457d3100) 00010000:00010000:3.0:1789043024.862957:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789043024.862961:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc28400, rc 0) 00000100:00100000:3.0:1789043024.863375:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+24:11538:x1875947242471808:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 903us (1919us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1789043024.863385:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 187 00000100:00100000:0.0:1789043024.877997:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043024.880971:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242471936 00000100:00100000:3.0:1789043024.880989:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242471936 00000100:00100000:3.0:1789043024.881051:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 188 00000100:00100000:3.0:1789043024.881061:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6ff0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+24:11538:x1875947242471936:12345-192.168.203.17@tcp:34:lfs.0 00010000:00010000:3.0:1789043024.881149:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06b64 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043024.881168:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06b64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043024.881180:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06b64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043024.881197:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06b6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043024.881218:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06b6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043024.881224:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06b6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043024.881465:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06b72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043024.881474:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06b72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043024.881481:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06b72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789043024.881550:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06b72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043024.881562:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06b64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043024.881568:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06b64 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043024.881713:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06b64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043024.881722:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc29000 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789043024.881727:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06b64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043024.881736:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06b64 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043024.881760:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa06a457d3100) 00010000:00010000:3.0:1789043024.881765:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789043024.881771:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06b64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043024.881777:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06b64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043024.881789:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06b6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043024.881796:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06b6b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043024.881801:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06b6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043024.881806:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc28a00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789043024.881809:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06b6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043024.881814:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06b6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043024.881821:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa06a55d80100) 00010000:00010000:3.0:1789043024.881824:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789043024.881827:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06b6b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043024.881833:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06b6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043024.881869:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06b72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043024.881875:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06b72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043024.881881:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06b72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043024.881886:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc28800 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789043024.881889:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06b72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043024.881896:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06b72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043024.881904:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a55d80200) 00010000:00010000:3.0:1789043024.881906:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789043024.881909:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06b72 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043024.881914:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06b72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043024.882618:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6ff0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+24:11538:x1875947242471936:12345-192.168.203.17@tcp:34:lfs.0 Request processed in 1546us (4621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043024.882633:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 188 00000100:00100000:3.0:1789043024.951451:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043024.951902:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242472192 00000100:00100000:1.0:1789043024.951917:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242472192 00000100:00100000:1.0:1789043024.951996:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 189 00000100:00100000:1.0:1789043024.952009:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+24:11541:x1875947242472192:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1789043024.952035:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043024.952064:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06b79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676bc3 expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043024.952180:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06b80 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043024.952200:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06b80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043024.952227:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06b80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043024.952259:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06b87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043024.952267:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06b87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043024.952274:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06b87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043024.952614:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06b8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043024.952623:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06b8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043024.952631:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06b8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789043024.952643:0:11703:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789043024.954993:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06b80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043024.955026:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06b80 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043024.955034:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06b80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043024.955041:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687400 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043024.955047:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06b80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043024.955509:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06b80 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043024.955551:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa06a457d3100) 00010000:00010000:1.0:1789043024.955555:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043024.955562:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06b80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043024.955569:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06b80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043024.955584:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06b87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043024.955590:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06b87 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043024.955597:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06b87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043024.955603:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043024.955606:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06b87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043024.955612:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06b87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043024.955621:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa06a44e19f00) 00010000:00010000:1.0:1789043024.955624:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043024.955628:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06b87 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043024.955645:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06b87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043024.955716:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06b79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bc3 expref: 27 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043024.955733:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06b8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bc3 expref: 26 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043024.955741:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19100) 00010000:00010000:1.0:1789043024.955743:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789043024.955746:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41686e00, rc 0) 00000100:00100000:1.0:1789043024.955964:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+26:11541:x1875947242472192:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 3956us (4528us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1789043024.955974:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 189 00000100:00100000:2.0:1789043024.968801:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043024.972920:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242472320 00000100:00100000:2.0:1789043024.972941:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242472320 00000100:00100000:2.0:1789043024.973020:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 190 00000100:00100000:2.0:1789043024.973032:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+26:11541:x1875947242472320:12345-192.168.203.17@tcp:54:lfs.0 00010000:00010000:2.0:1789043024.973118:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06b9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043024.973138:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06b9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043024.973152:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06b9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043024.973182:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06b9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043024.973189:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06b9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043024.973197:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06b9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043024.973220:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979a00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043024.973225:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06b9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043024.973234:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06b9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043024.973248:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19100) 00010000:00010000:2.0:1789043024.973252:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789043024.973258:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06b9c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043024.973265:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06b9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043024.973362:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+26:11541:x1875947242472320:12345-192.168.203.17@tcp:54:lfs.0 Request processed in 332us (4577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043024.973369:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 190 00000100:00100000:0.0:1789043024.981304:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043024.981382:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242472576 00000100:00100000:2.0:1789043024.981396:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242472576 00000100:00100000:2.0:1789043024.981455:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 51 00000100:00100000:2.0:1789043024.981467:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6ff0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+26:11541:x1875947242472576:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:2.0:1789043024.981813:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6ff0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+27:11541:x1875947242472576:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 348us (523us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1789043024.981821:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 51 00000100:00100000:2.0:1789043025.031693:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043025.031832:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242472832 00000100:00100000:1.0:1789043025.031853:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242472832 00000100:00100000:1.0:1789043025.031941:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 191 00000100:00100000:1.0:1789043025.031961:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+27:11068:x1875947242472832:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:1.0:1789043025.031994:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043025.032020:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06ba3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676bca expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.032167:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06baa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.032186:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06b8e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bc3 expref: 28 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.032216:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06baa lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.032274:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06b8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bc3 expref: 28 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.032291:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06b8e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bc3 expref: 28 pid: 11703 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043025.032309:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a026300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875947267635328:192.168.203.17@tcp:104: 00000100:00100000:1.0:1789043025.032450:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7f8ce900 going to sleep for 11 seconds 00000100:00080000:0.0:1789043025.032788:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789043025.035946:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a026300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875947267635328:192.168.203.17@tcp:104: 00010000:00010000:1.0:1789043025.036004:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06baa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043025.040166:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043025.041203:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242472960 00000100:00100000:3.0:1789043025.041220:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242472960 00010000:00010000:3.0:1789043025.041838:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06b8e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bc3 expref: 29 pid: 11703 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043025.041962:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 74 00000100:00100000:3.0:1789043025.041992:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+29:2352:x1875947242472960:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789043025.042012:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789043025.042031:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06b8e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bc3 expref: 29 pid: 11703 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.042050:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06b8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bc3 expref: 29 pid: 11703 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.042078:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06b8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bc3 expref: 29 pid: 11703 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.042100:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19100) 00010000:00010000:3.0:1789043025.042105:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06baa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.042116:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06baa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.042124:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06baa lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.042166:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789043025.042236:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+28:2352:x1875947242472960:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 248us (2085us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043025.042244:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 74 00010000:00010000:2.0:1789043025.044852:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06baa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.044895:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06baa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789043025.044927:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1789043025.045143:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06ba3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bca expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.045171:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06baa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bca expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.045182:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19100) 00010000:00010000:2.0:1789043025.045186:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789043025.045190:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41686200, rc 0) 00000100:00100000:2.0:1789043025.045293:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+28:11068:x1875947242472832:12345-192.168.203.17@tcp:101:bash.0 Request processed in 13342us (13614us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1789043025.045303:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 191 00000100:00100000:2.0:1789043025.054335:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043025.063312:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242473216 00000100:00100000:1.0:1789043025.063333:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242473216 00000100:00100000:1.0:1789043025.063726:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 192 00000100:00100000:1.0:1789043025.063744:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+28:11068:x1875947242473216:12345-192.168.203.17@tcp:36:bash.0 00010000:00010000:1.0:1789043025.064108:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06bb8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.064129:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06bb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.064145:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06bb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789043025.064229:0:11703:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1789043025.064269:0:11703:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000031934e94 reply state 000000003db70cd3 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06bb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043025.064279:0:11703:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789043025.064332:0:11703:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1789043025.064741:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+32:11068:x1875947242473216:12345-192.168.203.17@tcp:36:bash.0 Request processed in 999us (10416us total) trans 4294967475 rc 0/0 00010000:00010000:3.0:1789043025.073752:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06bb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.073775:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06bb8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.073803:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06bb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.073810:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687400 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789043025.073816:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06bb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.073826:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06bb8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.073857:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19100) 00010000:00010000:3.0:1789043025.073861:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789043025.073868:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06bb8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.073875:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06bb8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043025.074042:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043025.074131:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242473344 00000100:00100000:3.0:1789043025.074143:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242473344 00000100:00100000:1.0:1789043025.075139:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 192 00000020:00080000:1.0:1789043025.075150:0:11703:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1789043025.076625:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 193 00000100:00100000:2.0:1789043025.076654:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6ff0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+31:11068:x1875947242473344:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:2.0:1789043025.076689:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043025.076717:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06bbf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676bd1 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.076794:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06bbf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bd1 expref: 32 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.076907:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06bbf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bd1 expref: 32 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.076935:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19100) 00010000:00010000:2.0:1789043025.076939:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789043025.076943:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50979a00, rc 0) 00000100:00100000:2.0:1789043025.077028:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6ff0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+32:11068:x1875947242473344:12345-192.168.203.17@tcp:101:bash.0 Request processed in 387us (2991us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043025.077035:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 193 00000100:00100000:0.0:1789043025.084145:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043025.084272:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242473472 00000100:00100000:2.0:1789043025.084285:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242473472 00000100:00100000:2.0:1789043025.084375:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 58 00000100:00100000:2.0:1789043025.084389:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6ff0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:11068:x1875947242473472:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:2.0:1789043025.084417:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1789043025.084569:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789043025.084859:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075963653/0x99260d7389c06bc6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676bd8 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789043025.084895:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa2a14d, atime: 0x6aa2a14c, ctime: 0x6aa2a14d, blocks: 0xb 00010000:00010000:0.0:1789043025.084926:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=368s v=(0 0) 00010000:00010000:0.0:1789043025.084932:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043025.084942:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075963653/0x99260d7389c06bc6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bd8 expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043025.084964:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075963653/0x99260d7389c06bc6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bd8 expref: 8 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043025.084979:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a413a0200, rc 0) 00000100:00100000:0.0:1789043025.085061:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6ff0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:11068:x1875947242473472:12345-192.168.203.17@tcp:101:bash.0 Request processed in 675us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043025.085092:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 58 00000100:00100000:3.0:1789043025.094809:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043025.098835:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242473600 00000100:00100000:2.0:1789043025.098866:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242473600 00002000:00010000:2.0:1789043025.098942:0:6696:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1789043025.098948:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa06a7a8b6d80 with x1875947242473600 ext(0->18446744073709551615) 00002000:00010000:2.0:1789043025.098964:0:6696:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa06a7a8b6d80. 00000100:00100000:3.0:1789043025.100130:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 5 00000100:00100000:3.0:1789043025.100152:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:2351:x1875947242473600:12345-192.168.203.17@tcp:10:bash.0 00002000:00010000:3.0:1789043025.101081:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1789043025.101088:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789043021 -> 1789043025 00002000:00010000:3.0:1789043025.101091:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1789043020 -> 1789043020 00002000:00010000:3.0:1789043025.101093:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789043021 -> 1789043025 00002000:00010000:3.0:1789043025.101096:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1789043025.101252:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+9:2351:x1875947242473600:12345-192.168.203.17@tcp:10:bash.0 Request processed in 1099us (6448us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1789043025.101264:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 5 00002000:00010000:3.0:1789043025.101270:0:6696:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1789043025.101273:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa06a7a8b6d80 with x1875947242473600 ext(0->18446744073709551615) 00002000:00010000:3.0:1789043025.101280:0:6696:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa06a7a8b6d80. 00000100:00100000:3.0:1789043025.211603:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043025.213212:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242473728 00000100:00100000:2.0:1789043025.213233:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242473728 00000100:00100000:2.0:1789043025.213327:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 194 00000100:00100000:2.0:1789043025.213340:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+32:11555:x1875947242473728:12345-192.168.203.17@tcp:34:lfs.0 00010000:00010000:2.0:1789043025.213450:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06bcd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.213492:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06bcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.213506:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06bcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.213559:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c06bd4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.213567:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c06bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.213583:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c06bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.214117:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06bdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.214130:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06bdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.214138:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06bdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789043025.214190:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06bdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.214204:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06bcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.214211:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06bcd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.214231:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06bcd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.214238:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50978600 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043025.214243:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06bcd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.214253:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06bcd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.214268:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa06a457d3100) 00010000:00010000:2.0:1789043025.214272:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043025.214278:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06bcd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.214286:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06bcd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.214299:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c06bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.214305:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c06bd4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.214311:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c06bd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.214316:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50978000 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043025.214319:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c06bd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.214335:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c06bd4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.214343:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa06a457d3d00) 00010000:00010000:2.0:1789043025.214345:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043025.214348:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c06bd4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.214353:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c06bd4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.214367:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06bdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.214372:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06bdb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.214377:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06bdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.214382:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043025.214385:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06bdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.214390:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06bdb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.214396:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19100) 00010000:00010000:2.0:1789043025.214398:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043025.214400:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06bdb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.214414:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06bdb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043025.214977:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+32:11555:x1875947242473728:12345-192.168.203.17@tcp:34:lfs.0 Request processed in 1490us (3235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043025.214990:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 194 00010000:00010000:3.0:1789043025.268364:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789043025.284266:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043025.284917:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242473984 00000100:00100000:3.0:1789043025.284932:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242473984 00000100:00100000:3.0:1789043025.285011:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 195 00000100:00100000:3.0:1789043025.285023:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6ff0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+32:11558:x1875947242473984:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:3.0:1789043025.285053:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789043025.285083:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06be2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676bdf expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.285176:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06be9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.285193:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06be9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.285207:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06be9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.285223:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06bf0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.285230:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.285258:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.286036:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06bf7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.286049:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.286058:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789043025.286071:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789043025.286196:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06be9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.286205:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06be9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.286212:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06be9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.286220:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc28a00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789043025.286225:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06be9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.286233:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06be9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.286247:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa06a457d3100) 00010000:00010000:3.0:1789043025.286250:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789043025.286266:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06be9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.286272:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06be9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.286289:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.286296:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06bf0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.286301:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06bf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.286306:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc29000 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789043025.286992:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06bf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.287005:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06bf0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.287017:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa06a55d80200) 00010000:00010000:3.0:1789043025.287020:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789043025.287023:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06bf0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.287029:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06bf0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.287095:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06be2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bdf expref: 35 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.287128:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06bf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bdf expref: 34 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.287135:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19100) 00010000:00010000:3.0:1789043025.287138:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789043025.287140:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc29200, rc 0) 00000100:00100000:3.0:1789043025.288033:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6ff0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+34:11558:x1875947242473984:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 3004us (3776us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1789043025.288046:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 195 00000100:00100000:3.0:1789043025.297787:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043025.297899:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242474112 00000100:00100000:0.0:1789043025.297909:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242474112 00000100:00100000:1.0:1789043025.304838:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 196 00000100:00100000:1.0:1789043025.304875:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+34:11558:x1875947242474112:12345-192.168.203.17@tcp:54:lfs.0 00010000:00010000:1.0:1789043025.304944:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06c05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.304962:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06baa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bca expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.304973:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06c05 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.305010:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06baa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bca expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.305026:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06baa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bca expref: 34 pid: 5845 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043025.305041:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a026300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875947267635456:192.168.203.17@tcp:104: 00000100:00100000:1.0:1789043025.305158:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7f8ce0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789043025.307895:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a026300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875947267635456:192.168.203.17@tcp:104: 00010000:00010000:1.0:1789043025.307928:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06c05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043025.312157:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043025.312262:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242474368 00000100:00100000:2.0:1789043025.312275:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242474368 00000100:00100000:2.0:1789043025.312343:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 52 00000100:00100000:2.0:1789043025.312354:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+35:5593:x1875947242474368:12345-192.168.203.17@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789043025.312703:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+36:5593:x1875947242474368:12345-192.168.203.17@tcp:35:ldlm_bl.0 Request processed in 350us (556us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1789043025.312711:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 52 00000100:00100000:0.0:1789043025.315568:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043025.315760:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242474496 00000100:00100000:3.0:1789043025.315770:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242474496 00010000:00010000:3.0:1789043025.315814:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06baa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bca expref: 36 pid: 5845 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043025.315854:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 75 00000100:00100000:3.0:1789043025.315864:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+36:2349:x1875947242474496:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789043025.315878:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789043025.315884:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06baa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bca expref: 36 pid: 5845 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.315898:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06baa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bca expref: 36 pid: 5845 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.315919:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06baa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bca expref: 36 pid: 5845 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.315949:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19100) 00010000:00010000:3.0:1789043025.315954:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06c05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.315964:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06c05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.315972:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06c05 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.316009:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789043025.316065:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+35:2349:x1875947242474496:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 201us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043025.316073:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 75 00010000:00010000:2.0:1789043025.317162:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06c05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.317174:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06c05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.317202:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06c05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.317209:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06c05 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.317215:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06c05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.317222:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687400 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043025.317236:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06c05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.317245:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06c05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.317256:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19100) 00010000:00010000:2.0:1789043025.317259:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789043025.317262:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06c05 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.317268:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06c05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043025.317587:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+34:11558:x1875947242474112:12345-192.168.203.17@tcp:54:lfs.0 Request processed in 12722us (19805us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043025.317596:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 196 00000100:00100000:0.0:1789043025.325167:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043025.325250:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242474752 00000100:00100000:2.0:1789043025.325260:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242474752 00000100:00100000:2.0:1789043025.325328:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 53 00000100:00100000:2.0:1789043025.325338:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6ff0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+34:11558:x1875947242474752:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:2.0:1789043025.325597:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6ff0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+35:11558:x1875947242474752:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 260us (438us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1789043025.325605:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 53 00000100:00100000:0.0:1789043025.441943:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043025.442035:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242475008 00000100:00100000:1.0:1789043025.442045:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242475008 00000100:00100000:1.0:1789043025.442107:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 197 00000100:00100000:1.0:1789043025.442116:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6ff0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+35:11569:x1875947242475008:12345-192.168.203.17@tcp:101:cat.0 00010000:00010000:1.0:1789043025.442138:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043025.442156:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06c0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676be6 expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.442220:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06c13 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.442233:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06c13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.442243:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06c13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.442256:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06c1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.442263:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06c1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.442269:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06c1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.442506:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06c21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.442544:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06c21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.442552:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06c21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789043025.442562:0:11703:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1789043025.442644:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06c13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.442651:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06c13 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.442658:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06c13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.442664:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686e00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043025.442667:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06c13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.442675:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06c13 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.442686:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa06a457d3100) 00010000:00010000:1.0:1789043025.442689:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043025.442694:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06c13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.442710:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06c13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.442722:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06c1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.442728:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06c1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.442734:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06c1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.442738:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687000 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043025.442741:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06c1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.442747:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06c1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.442755:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa06a44e19f00) 00010000:00010000:1.0:1789043025.442757:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043025.442760:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06c1a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.442766:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06c1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.442801:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06c0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676be6 expref: 38 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.442824:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06c21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676be6 expref: 37 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.442832:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19100) 00010000:00010000:1.0:1789043025.442834:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789043025.442837:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41687e00, rc 0) 00000100:00100000:1.0:1789043025.442903:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6ff0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+37:11569:x1875947242475008:12345-192.168.203.17@tcp:101:cat.0 Request processed in 788us (968us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1789043025.442909:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 197 00000100:00100000:0.0:1789043025.455031:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043025.455232:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242475264 00000100:00100000:2.0:1789043025.455242:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242475264 00000100:00100000:2.0:1789043025.455301:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 54 00000100:00100000:2.0:1789043025.455311:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6ff0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+37:11569:x1875947242475264:12345-192.168.203.17@tcp:35:cat.0 00000100:00100000:2.0:1789043025.455597:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6ff0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+38:11569:x1875947242475264:12345-192.168.203.17@tcp:35:cat.0 Request processed in 286us (574us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1789043025.455617:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 54 00000100:00100000:0.0:1789043025.493327:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043025.493411:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242475520 00000100:00100000:3.0:1789043025.493420:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242475520 00000100:00100000:3.0:1789043025.493494:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 198 00000100:00100000:3.0:1789043025.493505:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6ff0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+38:11570:x1875947242475520:12345-192.168.203.17@tcp:36:rm.0 00010000:00010000:3.0:1789043025.493595:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789043025.493623:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06c21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676be6 expref: 38 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.493647:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06bf7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bdf expref: 37 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.493659:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06bbf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bd1 expref: 36 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.493688:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a44e19100) 00010000:00010000:3.0:1789043025.493699:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789043025.493854:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06c2f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.493870:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06c2f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.493883:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06c2f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.493901:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06c36 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.493917:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06c36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.493924:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06c36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.494168:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06c3d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.494178:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06c3d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.494186:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06c3d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789043025.494804:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:3.0:1789043025.494816:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 368451301105ns, next at 369451298341ns, rc = 0 00010000:00010000:3.0:1789043025.494904:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06c44 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.494915:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06c44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.494923:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06c44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.494931:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06c44 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.494937:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06c44 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.494943:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06c44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.494966:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789043025.494985:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06c3d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.494991:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06c3d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.494996:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06c3d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.495001:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc28a00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789043025.495005:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06c3d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.495012:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06c3d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.495029:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a55d80100) 00010000:00010000:3.0:1789043025.495032:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789043025.495036:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06c3d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.495042:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06c3d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.495059:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06c2f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.495066:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06c2f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.495071:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06c2f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.495077:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc28800 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789043025.495079:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06c2f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.495085:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06c2f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.495093:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa06a457d3100) 00010000:00010000:3.0:1789043025.495095:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789043025.495098:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06c2f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.495104:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06c2f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789043025.495122:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9e909bc reply state 00000000dae74ab7 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06c36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043025.495131:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789043025.495220:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6ff0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+37:11570:x1875947242475520:12345-192.168.203.17@tcp:36:rm.0 Request processed in 1713us (1909us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1789043025.495229:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 198 00010000:00010000:2.0:1789043025.495464:0:11175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789043025.495471:0:11175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06c44 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.495476:0:11175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc28200 already unused, calling callback (ffffffffc1470760) 00010000:00010000:2.0:1789043025.495479:0:11175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06c44 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.495486:0:11175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06c44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.495495:0:11175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa06a55d80100) 00010000:00010000:2.0:1789043025.495497:0:11175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789043025.495500:0:11175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06c44 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.495506:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28200/0x99260d7389c06c44 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.495559:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043025.495561:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043025.495563:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043025.499085:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06c36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.499102:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06c36 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.499110:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06c36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.499117:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc29000 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789043025.499122:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06c36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.499130:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06c36 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.499145:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa06a55d80200) 00010000:00010000:3.0:1789043025.499149:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789043025.499154:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06c36 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.499160:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06c36 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043025.563408:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043025.563504:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242475776 00000100:00100000:2.0:1789043025.563539:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242475776 00000100:00100000:2.0:1789043025.563600:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 199 00000100:00100000:2.0:1789043025.563610:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6ff0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+36:11576:x1875947242475776:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:2.0:1789043025.563633:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043025.563651:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06c4b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676bed expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.563790:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c06c52 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.563804:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c06c52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.563815:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c06c52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.563826:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06c59 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.563832:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06c59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.563838:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06c59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789043025.564318:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1789043025.564468:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06c60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.564478:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06c60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.564486:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06c60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.564547:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c06c52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.564566:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c06c52 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.564572:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c06c52 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.564577:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50978000 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043025.564582:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c06c52 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.564588:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c06c52 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.564599:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa06a457d3100) 00010000:00010000:2.0:1789043025.564602:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043025.564607:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c06c52 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.564613:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c06c52 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789043025.564625:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fab3dc8e reply state 00000000a1670a89 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06c59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043025.564634:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789043025.564666:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06c4b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bed expref: 39 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.564680:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06c60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bed expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.564699:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a457d3f00) 00010000:00010000:2.0:1789043025.564701:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789043025.564704:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50978e00, rc 0) 00000100:00100000:2.0:1789043025.564774:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6ff0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+39:11576:x1875947242475776:12345-192.168.203.17@tcp:101:bash.0 Request processed in 1165us (1375us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1789043025.564782:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 199 00010000:00010000:3.0:1789043025.566894:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06c59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.566910:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06c59 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.566917:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06c59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.566924:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50978600 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789043025.566928:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06c59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.566935:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06c59 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.566949:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa06a457d3d00) 00010000:00010000:3.0:1789043025.566952:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789043025.566956:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06c59 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.566963:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06c59 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043025.570460:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043025.570593:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242475904 00000100:00100000:3.0:1789043025.570602:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242475904 00000100:00100000:3.0:1789043025.570667:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 59 00000100:00100000:3.0:1789043025.570678:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6ff0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2352:x1875947242475904:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:3.0:1789043025.570695:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789043025.570736:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009d8507f/0x99260d7389c06c6e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676bf4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789043025.570764:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789043025.570781:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=368s v=(0 0) 00010000:00010000:3.0:1789043025.570786:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789043025.570795:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009d8507f/0x99260d7389c06c6e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bf4 expref: 6 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.570816:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000009d8507f/0x99260d7389c06c6e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bf4 expref: 6 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.570830:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc29000, rc 0) 00000100:00100000:3.0:1789043025.570902:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6ff0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2352:x1875947242475904:12345-192.168.203.17@tcp:101:bash.0 Request processed in 226us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043025.570908:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 59 00000100:00080000:0.0:1789043025.571389:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789043025.574178:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043025.574256:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242476032 00000100:00100000:3.0:1789043025.574268:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242476032 00000100:00100000:3.0:1789043025.574334:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 60 00000100:00100000:3.0:1789043025.574344:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6ff0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:11576:x1875947242476032:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:3.0:1789043025.574360:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789043025.574378:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d88b0774/0x99260d7389c06c75 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676bfb expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.574411:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000009d8507f/0x99260d7389c06c6e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bf4 expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.574432:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789043025.574437:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789043025.574442:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d88b0774/0x99260d7389c06c75 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bfb expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.574476:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000009d8507f/0x99260d7389c06c6e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bf4 expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.574488:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000009d8507f/0x99260d7389c06c6e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bf4 expref: 7 pid: 6690 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043025.574502:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6692:1875947267635584:192.168.203.17@tcp:104: 00000100:00100000:3.0:1789043025.574669:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7726cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789043025.579036:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043025.579252:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242476160 00000100:00100000:0.0:1789043025.579262:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242476160 00010000:00010000:0.0:1789043025.579300:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000009d8507f/0x99260d7389c06c6e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bf4 expref: 8 pid: 6690 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043025.579347:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 76 00000100:00100000:0.0:1789043025.579356:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a026300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:2351:x1875947242476160:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789043025.579370:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789043025.579392:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000009d8507f/0x99260d7389c06c6e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bf4 expref: 8 pid: 6690 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043025.579405:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000009d8507f/0x99260d7389c06c6e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bf4 expref: 8 pid: 6690 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043025.579448:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043025.579452:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043025.579461:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d88b0774/0x99260d7389c06c75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bfb expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043025.579471:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d88b0774/0x99260d7389c06c75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bfb expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043025.579510:0:6705:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d88b0774/0x99260d7389c06c75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bfb expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043025.579552:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6ff0d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6705:1875947267635712:192.168.203.17@tcp:105: 00000100:00100000:0.0:1789043025.579631:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a52c30a80 going to sleep for 11 seconds 00010000:00010000:3.0:1789043025.580776:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009d8507f/0x99260d7389c06c6e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bf4 expref: 8 pid: 6690 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043025.580796:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6692:1875947267635584:192.168.203.17@tcp:104: 00010000:00010000:3.0:1789043025.580824:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d88b0774/0x99260d7389c06c75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bfb expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.580836:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc28800, rc 0) 00000100:00100000:3.0:1789043025.580901:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6ff0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:11576:x1875947242476032:12345-192.168.203.17@tcp:101:bash.0 Request processed in 6559us (6732us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043025.580928:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 60 00000100:00100000:1.0:1789043025.589120:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043025.589286:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242476416 00000100:00100000:0.0:1789043025.589296:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242476416 00000100:00100000:2.0:1789043025.589325:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6ff0d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6705:1875947267635712:192.168.203.17@tcp:105: 00010000:00010000:2.0:1789043025.589349:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789043025.589357:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 55 00000100:00100000:0.0:1789043025.589366:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+38:11576:x1875947242476416:12345-192.168.203.17@tcp:35:bash.0 00000100:00100000:2.0:1789043025.589450:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a026300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2351:x1875947242476160:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 10094us (10423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043025.589460:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 76 00000100:00100000:0.0:1789043025.589765:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+39:11576:x1875947242476416:12345-192.168.203.17@tcp:35:bash.0 Request processed in 399us (654us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1789043025.589771:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 55 00000100:00100000:0.0:1789043025.735435:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043025.737049:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242476544 00000100:00100000:2.0:1789043025.737077:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242476544 00000100:00100000:2.0:1789043025.737163:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 200 00000100:00100000:2.0:1789043025.737174:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6ff0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+39:11592:x1875947242476544:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:2.0:1789043025.737200:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043025.737220:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c06c7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676c02 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.737294:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c06c83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.737309:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c06c83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.737322:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c06c83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789043025.737371:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789043025.737374:0:6714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789043025.737393:0:6714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c06c83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.737421:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978a00/0x99260d7389c06c7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c02 expref: 41 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.737441:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c06c83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c02 expref: 40 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.737450:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa06a457d3100) 00010000:00010000:2.0:1789043025.737453:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789043025.737457:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50978000, rc 0) 00000100:00100000:2.0:1789043025.737560:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6ff0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+40:11592:x1875947242476544:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 387us (2132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043025.737567:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 200 00000100:00100000:2.0:1789043025.742783:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043025.743036:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242476800 00000100:00100000:3.0:1789043025.743046:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242476800 00000100:00100000:3.0:1789043025.743105:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 201 00000100:00100000:3.0:1789043025.743116:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+40:11592:x1875947242476800:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:3.0:1789043025.743137:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789043025.743160:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06c8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676c09 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.743264:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06c91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.743278:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06c91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.743288:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06c91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789043025.743299:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789043025.743999:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06c8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c09 expref: 43 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.744020:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06c91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c09 expref: 42 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.744029:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a457d3f00) 00010000:00010000:3.0:1789043025.744032:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789043025.744035:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc29000, rc 0) 00000100:00100000:3.0:1789043025.744183:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+42:11592:x1875947242476800:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 1067us (1409us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1789043025.744191:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 201 00000100:00100000:0.0:1789043025.748038:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043025.749175:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242477056 00000100:00100000:1.0:1789043025.749188:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242477056 00000100:00100000:1.0:1789043025.749251:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 202 00000100:00100000:1.0:1789043025.749261:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6ff0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+42:11592:x1875947242477056:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1789043025.749287:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043025.749309:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06c9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676c10 expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.749409:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06ca6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.749424:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06ca6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.749436:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06ca6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789043025.749470:0:11703:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789043025.749610:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06c9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c10 expref: 45 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.749627:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06ca6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c10 expref: 44 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.749635:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a457d3f00) 00010000:00010000:1.0:1789043025.749637:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789043025.749641:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41686e00, rc 0) 00000100:00100000:1.0:1789043025.749702:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6ff0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+44:11592:x1875947242477056:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 442us (1674us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1789043025.749709:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 202 00000100:00100000:1.0:1789043025.749824:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043025.749908:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242477184 00000100:00100000:1.0:1789043025.749913:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242477184 00000100:00100000:1.0:1789043025.749945:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 15 00000100:00100000:1.0:1789043025.749952:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a024000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+44:2349:x1875947242477184:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789043025.749966:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789043025.749980:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29000/0x99260d7389c06c91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c09 expref: 44 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.749990:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a457d3f00) 00010000:00010000:1.0:1789043025.749993:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789043025.750015:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a024000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+43:2349:x1875947242477184:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 64us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043025.750031:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 15 00000100:00100000:1.0:1789043025.756873:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043025.757718:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242477312 00000100:00100000:0.0:1789043025.757730:0:8215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242477312 00000100:00100000:0.0:1789043025.757806:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 61 00000100:00100000:0.0:1789043025.757817:0:8215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a51875c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+6:2351:x1875947242477312:12345-192.168.203.17@tcp:1:lfs.0 00010000:00010000:0.0:1789043025.757880:0:8215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce0c100b/0x99260d7389c06cb4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043025.757902:0:8215:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d88b0774/0x99260d7389c06c75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bfb expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043025.757911:0:8215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043025.757915:0:8215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789043025.757920:0:8215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce0c100b/0x99260d7389c06cb4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043025.757955:0:8215:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d88b0774/0x99260d7389c06c75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bfb expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043025.757969:0:8215:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d88b0774/0x99260d7389c06c75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bfb expref: 6 pid: 6692 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043025.757983:0:8215:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6ff0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8215:1875947267635840:192.168.203.17@tcp:104: 00000100:00100000:0.0:1789043025.758076:0:8215:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a52c30900 going to sleep for 11 seconds 00000100:00100000:0.0:1789043025.761569:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043025.761861:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242477440 00000100:00100000:2.0:1789043025.761871:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242477440 00002000:00100000:2.0:1789043025.761933:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffffa06a6ff0dc00 x1875947242477440/t0(0) o4->3fb32839-ebfd-4c0f-90e4-f036c86704df@192.168.203.17@tcp:321/0 lens 504/0 e 0 to 0 dl 1789043036 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789043025.761945:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa06a6ff0dc00 with x1875947242477440 ext(0->8) 00010000:00010000:2.0:1789043025.761954:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d88b0774/0x99260d7389c06c75 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bfb expref: 7 pid: 6692 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.761971:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d88b0774/0x99260d7389c06c75 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bfb expref: 7 pid: 6692 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789043025.761996:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa06a6ff0dc00 00000100:00100000:2.0:1789043025.762036:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 3 00000100:00100000:2.0:1789043025.762046:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6ff0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2352:x1875947242477440:12345-192.168.203.17@tcp:4:lfs.0 00000100:00100000:1.0:1789043025.762165:0:8215:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6ff0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8215:1875947267635840:192.168.203.17@tcp:104: 00010000:00010000:1.0:1789043025.762187:0:8215:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ce0c100b/0x99260d7389c06cb4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043025.762711:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6ff0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+9:2352:x1875947242477440:12345-192.168.203.17@tcp:4:lfs.0 Request processed in 666us (1151us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789043025.762719:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 3 00002000:00100000:2.0:1789043025.762726:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffffa06a6ff0dc00 x1875947242477440/t4294967308(0) o4->3fb32839-ebfd-4c0f-90e4-f036c86704df@192.168.203.17@tcp:321/0 lens 504/448 e 0 to 0 dl 1789043036 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789043025.762734:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa06a6ff0dc00 with x1875947242477440 ext(0->8) 00010000:00010000:2.0:1789043025.762740:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d88b0774/0x99260d7389c06c75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bfb expref: 9 pid: 6692 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.762754:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d88b0774/0x99260d7389c06c75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bfb expref: 9 pid: 6692 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789043025.762761:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa06a6ff0dc00 00000100:00100000:2.0:1789043025.766647:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043025.766764:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242477568 00000100:00100000:1.0:1789043025.766773:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242477568 00010000:00010000:1.0:1789043025.766816:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d88b0774/0x99260d7389c06c75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bfb expref: 9 pid: 6692 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043025.766899:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 77 00000100:00100000:1.0:1789043025.766909:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+9:2351:x1875947242477568:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789043025.766924:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789043025.766945:0:5833:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789043025.766947:0:5833:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789043025 00002000:00010000:1.0:1789043025.766950:0:5833:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789043026 00002000:00010000:1.0:1789043025.766952:0:5833:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789043025 00010000:00010000:1.0:1789043025.766958:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d88b0774/0x99260d7389c06c75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bfb expref: 9 pid: 6692 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.766971:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d88b0774/0x99260d7389c06c75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bfb expref: 9 pid: 6692 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.766994:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d88b0774/0x99260d7389c06c75 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bfb expref: 9 pid: 6692 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.767024:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789043025.767029:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789043025.767035:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce0c100b/0x99260d7389c06cb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.767044:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce0c100b/0x99260d7389c06cb4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.767077:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789043025.767137:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:2351:x1875947242477568:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 229us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043025.767145:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 77 00010000:00010000:2.0:1789043025.767336:0:8215:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ce0c100b/0x99260d7389c06cb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.767346:0:8215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce0c100b/0x99260d7389c06cb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.767372:0:8215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce0c100b/0x99260d7389c06cb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.767387:0:8215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce0c100b/0x99260d7389c06cb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.767396:0:8215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce0c100b/0x99260d7389c06cb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.767403:0:8215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a413a0e00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:2.0:1789043025.767408:0:8215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce0c100b/0x99260d7389c06cb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.767416:0:8215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce0c100b/0x99260d7389c06cb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.767428:0:8215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce0c100b/0x99260d7389c06cb4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.767446:0:8215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce0c100b/0x99260d7389c06cb4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043025.767507:0:8215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a51875c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2351:x1875947242477312:12345-192.168.203.17@tcp:1:lfs.0 Request processed in 9692us (10643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043025.767547:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 61 00000100:00100000:2.0:1789043025.770723:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043025.770804:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242477824 00000100:00100000:3.0:1789043025.770815:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242477824 00000100:00100000:3.0:1789043025.770872:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 56 00000100:00100000:3.0:1789043025.770883:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5ffdc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+43:11592:x1875947242477824:12345-192.168.203.17@tcp:35:lfs.0 00000004:00010000:3.0:1789043025.770944:0:5849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06ca6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c10 expref: 43 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789043025.771186:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1789043025.771234:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1789043025.771582:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1789043025.771635:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06cbb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.771653:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06c60 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bed expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.771663:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06cbb lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.771697:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06c60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bed expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.771712:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06c60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bed expref: 47 pid: 5846 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043025.771725:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6f1e1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5849:1875947267635968:192.168.203.17@tcp:104: 00000100:00100000:3.0:1789043025.771817:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a585ae240 going to sleep for 11 seconds 00000100:00100000:3.0:1789043025.776017:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043025.776107:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242477952 00000100:00100000:2.0:1789043025.776117:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242477952 00010000:00010000:2.0:1789043025.776172:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06c60 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bed expref: 48 pid: 5846 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043025.776214:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 78 00000100:00100000:2.0:1789043025.776223:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+48:2352:x1875947242477952:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789043025.776238:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789043025.776244:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06c60 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bed expref: 48 pid: 5846 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.776257:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06c60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bed expref: 48 pid: 5846 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.776279:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a457d3f00) 00010000:00010000:2.0:1789043025.776284:0:6705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06cbb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.776294:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06cbb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.776301:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06cbb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.776330:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789043025.776392:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+48:2352:x1875947242477952:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 169us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043025.776399:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 78 00010000:00010000:1.0:1789043025.776457:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06c60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bed expref: 47 pid: 5846 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043025.776556:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6f1e1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5849:1875947267635968:192.168.203.17@tcp:104: 00010000:00010000:1.0:1789043025.776578:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06cbb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.776586:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06cbb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.776592:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06cbb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789043025.776714:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1789043025.777243:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1789043025.777356:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a026d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1875947267636096:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789043025.777580:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043025.777603:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7f8ce9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789043025.777654:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267636096 00000100:00100000:0.0:1789043025.777661:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267636096 00000100:00100000:0.0:1789043025.777736:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789043025.777745:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5849:x1875947267636096:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789043025.777831:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5849:x1875947267636096:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 87us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043025.777847:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789043025.777906:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a026d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1875947267636096:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789043025.778401:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1789043025.778461:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a026d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1875947267636224:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789043025.778490:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043025.778572:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a46eaa000 going to sleep for 11 seconds 00000100:00100000:3.0:1789043025.778638:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267636224 00000100:00100000:3.0:1789043025.778643:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267636224 00000100:00100000:3.0:1789043025.778675:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789043025.778682:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a585b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5849:x1875947267636224:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789043025.778889:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a585b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5849:x1875947267636224:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 207us (397us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789043025.778896:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789043025.778995:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a026d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1875947267636224:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789043025.779032:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1789043025.779068:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06cbb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.779078:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06cbb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.779085:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06cbb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.779090:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc29200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043025.779095:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06cbb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.779102:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06cbb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.779117:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a457d3f00) 00010000:00010000:2.0:1789043025.779120:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789043025.779125:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06cbb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.779132:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06cbb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789043025.779295:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789043025.779468:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1789043025.779480:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 368735965299ns, next at 369735963274ns, rc = 0 00000001:00080000:2.0:1789043025.779487:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1789043025.779551:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a457d3f00) 00010000:00010000:2.0:1789043025.779554:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789043025.779561:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06ca6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c10 expref: 51 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043025.779713:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5ffdc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+50:11592:x1875947242477824:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 8831us (8998us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1789043025.779721:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 56 00000020:00080000:2.0:1789043025.779725:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789043025.782508:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043025.782567:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242478080 00000100:00100000:1.0:1789043025.782577:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242478080 00000100:00100000:1.0:1789043025.782630:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 203 00000100:00100000:1.0:1789043025.782640:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+50:11592:x1875947242478080:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1789043025.782667:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043025.782690:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06cc2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676c17 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.782762:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06cc2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c17 expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.782775:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06cc2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c17 expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043025.782790:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:1.0:1789043025.782792:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789043025.782795:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41687000, rc 0) 00000100:00100000:1.0:1789043025.782837:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+51:11592:x1875947242478080:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 198us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043025.782868:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 203 00000100:00100000:1.0:1789043025.785795:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043025.785900:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242478336 00000100:00100000:0.0:1789043025.785910:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242478336 00000100:00100000:0.0:1789043025.785991:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 57 00000100:00100000:0.0:1789043025.786002:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a585b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+51:11592:x1875947242478336:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:0.0:1789043025.786241:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a585b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+52:11592:x1875947242478336:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 240us (453us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1789043025.786249:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 57 00000100:00100000:0.0:1789043025.864462:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043025.864560:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242478464 00000100:00100000:3.0:1789043025.864571:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242478464 00000100:00100000:3.0:1789043025.864635:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 204 00000100:00100000:3.0:1789043025.864645:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6ff0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+52:11602:x1875947242478464:12345-192.168.203.17@tcp:34:lfs.0 00010000:00010000:3.0:1789043025.864720:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06cc9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.864738:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06cc9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.864750:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06cc9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.864766:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06cd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.864773:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.864780:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.864891:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06cd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.864901:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.864908:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789043025.864949:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.864961:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06cc9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.864968:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06cc9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.864975:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06cc9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.864980:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc28a00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789043025.864984:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06cc9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.864992:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06cc9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.865003:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa06a457d3100) 00010000:00010000:3.0:1789043025.865006:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789043025.865011:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06cc9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.865025:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28a00/0x99260d7389c06cc9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.865039:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.865045:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06cd0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.865051:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06cd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.865056:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc29200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789043025.865059:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06cd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.865065:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06cd0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.865073:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa06a55d80d00) 00010000:00010000:3.0:1789043025.865075:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789043025.865078:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06cd0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.865084:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06cd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.865098:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.865104:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06cd7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.865131:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06cd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.865136:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc28800 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789043025.865139:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06cd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.865146:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06cd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.865154:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:3.0:1789043025.865156:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789043025.865159:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06cd7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043025.865164:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06cd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043025.865240:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6ff0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+52:11602:x1875947242478464:12345-192.168.203.17@tcp:34:lfs.0 Request processed in 595us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043025.865248:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 204 00000100:00100000:1.0:1789043025.915097:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043025.915307:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242478720 00000100:00100000:0.0:1789043025.915318:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242478720 00000100:00100000:0.0:1789043025.915378:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 205 00000100:00100000:0.0:1789043025.915389:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a585b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+52:11605:x1875947242478720:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:0.0:1789043025.915415:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789043025.915437:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c06cde lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676c1e expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043025.915561:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c06ce5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043025.915578:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c06ce5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043025.915590:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c06ce5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043025.915623:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06cec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043025.915631:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06cec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043025.915638:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06cec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043025.915761:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06cf3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043025.915769:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043025.915777:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789043025.915787:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789043025.915893:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c06ce5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043025.915901:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c06ce5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043025.915908:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c06ce5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043025.915914:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a413a0600 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789043025.915919:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c06ce5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043025.915937:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c06ce5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043025.915949:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa06a457d3100) 00010000:00010000:0.0:1789043025.915952:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789043025.915957:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c06ce5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043025.915964:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c06ce5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043025.915978:0:6714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06cec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043025.915983:0:6714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06cec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043025.915988:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06cec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043025.915993:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a413a0e00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789043025.915995:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06cec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043025.916002:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06cec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043025.916008:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa06a55221b00) 00010000:00010000:0.0:1789043025.916011:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789043025.916013:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06cec lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043025.916029:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06cec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043025.916071:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c06cde lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c1e expref: 55 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043025.916084:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06cf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c1e expref: 54 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043025.916092:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:0.0:1789043025.916094:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789043025.916096:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a40031600, rc 0) 00000100:00100000:0.0:1789043025.916495:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a585b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+54:11605:x1875947242478720:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 1106us (1405us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1789043025.916504:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 205 00000100:00100000:1.0:1789043025.926924:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043025.927088:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242478848 00000100:00100000:2.0:1789043025.927101:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242478848 00000100:00100000:2.0:1789043025.927162:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 206 00000100:00100000:2.0:1789043025.927173:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a585b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+54:11605:x1875947242478848:12345-192.168.203.17@tcp:54:lfs.0 00010000:00010000:2.0:1789043025.927248:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06d01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.927266:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06d01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.927278:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06d01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.927303:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06d01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.927319:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06d01 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.927326:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06d01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.927332:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979a00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043025.927337:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06d01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.927358:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06d01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.927370:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:2.0:1789043025.927373:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789043025.927379:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06d01 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043025.927385:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06d01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043025.927463:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a585b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+54:11605:x1875947242478848:12345-192.168.203.17@tcp:54:lfs.0 Request processed in 290us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043025.927470:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 206 00000100:00100000:2.0:1789043025.932020:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043025.932280:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242479104 00000100:00100000:1.0:1789043025.932292:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242479104 00000100:00100000:1.0:1789043025.932366:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 58 00000100:00100000:1.0:1789043025.932376:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+54:11605:x1875947242479104:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:1.0:1789043025.932632:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+55:11605:x1875947242479104:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 256us (620us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1789043025.932640:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 58 00000100:00100000:3.0:1789043026.028334:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043026.028897:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242479360 00000100:00100000:0.0:1789043026.028908:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242479360 00000100:00100000:0.0:1789043026.029025:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 207 00000100:00100000:0.0:1789043026.029037:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+55:11615:x1875947242479360:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:0.0:1789043026.029070:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789043026.029074:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789043026.029099:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978000/0x99260d7389c06c83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c02 expref: 55 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.029118:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa06a457d3100) 00010000:00010000:0.0:1789043026.029123:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789043026.029151:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06d08 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676c25 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.029253:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06d0f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.029267:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06cf3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c1e expref: 55 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.029275:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06d0f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.029308:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06cf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c1e expref: 55 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.029322:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06cf3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c1e expref: 55 pid: 6714 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043026.029335:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6ff0f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1875947267636352:192.168.203.17@tcp:104: 00000100:00100000:0.0:1789043026.029508:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a52c30300 going to sleep for 11 seconds 00000100:00100000:0.0:1789043026.032032:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6ff0f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1875947267636352:192.168.203.17@tcp:104: 00010000:00010000:0.0:1789043026.032104:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06d0f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043026.036457:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043026.036681:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242479488 00000100:00100000:3.0:1789043026.036691:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242479488 00010000:00010000:3.0:1789043026.036733:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06cf3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c1e expref: 56 pid: 6714 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043026.036782:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 79 00000100:00100000:3.0:1789043026.036794:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a77122d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+56:2352:x1875947242479488:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789043026.036824:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789043026.036832:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06cf3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c1e expref: 56 pid: 6714 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.036854:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06cf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c1e expref: 56 pid: 6714 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.036876:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031600/0x99260d7389c06cf3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c1e expref: 56 pid: 6714 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.036891:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:3.0:1789043026.036895:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06d0f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.036905:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06d0f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.036911:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06d0f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.037031:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789043026.037135:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a77122d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+55:2352:x1875947242479488:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 342us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043026.037143:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 79 00010000:00010000:1.0:1789043026.037332:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06d0f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.037341:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06d0f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789043026.037361:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789043026.037511:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031000/0x99260d7389c06d08 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c25 expref: 56 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.037562:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06d0f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c25 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.037569:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:1.0:1789043026.037571:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789043026.037582:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a40031a00, rc 0) 00000100:00100000:1.0:1789043026.037607:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+55:11615:x1875947242479360:12345-192.168.203.17@tcp:101:bash.0 Request processed in 8574us (9290us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1789043026.037614:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 207 00000100:00100000:1.0:1789043026.040735:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043026.040801:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242479744 00000100:00100000:2.0:1789043026.040811:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242479744 00000100:00100000:2.0:1789043026.040897:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 208 00000100:00100000:2.0:1789043026.040907:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a77123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+55:11615:x1875947242479744:12345-192.168.203.17@tcp:36:bash.0 00010000:00010000:2.0:1789043026.041171:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06d1d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.041188:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06d1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.041200:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06d1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789043026.041251:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1789043026.041291:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f6c72ee reply state 00000000cf8a7280 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06d1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043026.041300:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789043026.041655:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a77123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+58:11615:x1875947242479744:12345-192.168.203.17@tcp:36:bash.0 Request processed in 747us (928us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1789043026.041663:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 208 00000020:00080000:2.0:1789043026.041668:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789043026.045316:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043026.045389:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242479872 00000100:00100000:1.0:1789043026.045400:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242479872 00000100:00100000:1.0:1789043026.045462:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 209 00000100:00100000:1.0:1789043026.045473:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+58:11615:x1875947242479872:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:1.0:1789043026.045499:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043026.045549:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06d24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676c2c expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.045635:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06d2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.045651:0:11703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06d0f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c25 expref: 59 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.045659:0:11703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06d1d lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.045666:0:11703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06d2b lrc: 5/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.045683:0:11703:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06d1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.045709:0:11703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06d0f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c25 expref: 59 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.045743:0:11703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06d0f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c25 expref: 59 pid: 5847 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043026.045758:0:11703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a77120380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11703:1875947267636480:192.168.203.17@tcp:104: 00000100:00100000:1.0:1789043026.045848:0:11703:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a46eaa000 going to sleep for 11 seconds 00010000:00010000:3.0:1789043026.047942:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06d1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.047957:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06d1d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.047983:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06d1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.047990:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979400 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789043026.047994:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06d1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.048002:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06d1d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.048019:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:3.0:1789043026.048023:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789043026.048026:0:3298:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06d2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.048037:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06d1d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.048042:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06d1d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043026.048298:0:11703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a77120380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11703:1875947267636480:192.168.203.17@tcp:104: 00010000:00010000:0.0:1789043026.048341:0:11703:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06d2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043026.049417:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043026.049489:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242480000 00000100:00100000:1.0:1789043026.049498:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242480000 00010000:00010000:1.0:1789043026.049562:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06d0f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c25 expref: 59 pid: 5847 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043026.049598:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 80 00000100:00100000:1.0:1789043026.049609:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+59:2351:x1875947242480000:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789043026.049623:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789043026.049629:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06d0f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c25 expref: 59 pid: 5847 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.049641:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06d0f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c25 expref: 59 pid: 5847 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.049660:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031a00/0x99260d7389c06d0f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c25 expref: 59 pid: 5847 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.049674:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:1.0:1789043026.049679:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06d2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.049703:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06d2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.049710:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06d2b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.049734:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789043026.049785:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+58:2351:x1875947242480000:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 178us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043026.049793:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 80 00010000:00010000:0.0:1789043026.049909:0:11703:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06d2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.049920:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06d2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789043026.049955:0:11703:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789043026.049958:0:11703:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789043026.049973:0:11703:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06d2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.049994:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06d24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c2c expref: 58 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.050004:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06d2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c2c expref: 57 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.050009:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:0.0:1789043026.050011:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789043026.050013:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41686200, rc 0) 00000100:00100000:0.0:1789043026.050031:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+57:11615:x1875947242479872:12345-192.168.203.17@tcp:101:bash.0 Request processed in 4563us (4740us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043026.050035:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 209 00000100:00100000:1.0:1789043026.052909:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043026.053026:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242480256 00000100:00100000:2.0:1789043026.053035:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242480256 00000100:00100000:2.0:1789043026.053209:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 59 00000100:00100000:2.0:1789043026.053220:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a77122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+57:11615:x1875947242480256:12345-192.168.203.17@tcp:35:bash.0 00000100:00100000:2.0:1789043026.053640:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a77122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+58:11615:x1875947242480256:12345-192.168.203.17@tcp:35:bash.0 Request processed in 420us (737us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1789043026.053647:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 59 00000100:00100000:3.0:1789043026.163649:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043026.163745:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242480384 00000100:00100000:1.0:1789043026.163755:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242480384 00000100:00100000:1.0:1789043026.163822:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 210 00000100:00100000:1.0:1789043026.163834:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+58:11621:x1875947242480384:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1789043026.163870:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043026.163896:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06d32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676c33 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.163969:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06d39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.163985:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.163998:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789043026.164035:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789043026.164051:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789043026.164087:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.164115:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06d32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c33 expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.164135:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06d39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c33 expref: 59 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.164143:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa06a457d3100) 00010000:00010000:1.0:1789043026.164146:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789043026.164150:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41687e00, rc 0) 00000100:00100000:1.0:1789043026.164211:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+59:11621:x1875947242480384:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 379us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043026.164218:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 210 00000100:00100000:0.0:1789043026.168497:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043026.168645:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242480512 00000100:00100000:2.0:1789043026.168656:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242480512 00000100:00100000:2.0:1789043026.168721:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 211 00000100:00100000:2.0:1789043026.168732:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6ff0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+59:11621:x1875947242480512:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:2.0:1789043026.168752:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043026.168772:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c06d40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676c3a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.168870:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06d47 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.168884:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06d47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.168904:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06d47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.168919:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06d4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.168926:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06d4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.168932:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06d4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.169017:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06d55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.169027:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06d55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.169034:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06d55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789043026.169091:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789043026.169096:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789043026.169114:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06d55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.169125:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06d55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.169133:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06d47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.169148:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06d47 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.169155:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06d47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.169161:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50978800 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043026.169165:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06d47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.169173:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06d47 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.169183:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa06a457d3100) 00010000:00010000:2.0:1789043026.169186:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043026.169192:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06d47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.169198:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06d47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.169211:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06d4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.169216:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06d4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.169222:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06d4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.169227:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979400 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043026.169236:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06d4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.169243:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06d4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.169251:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa06a457d3f00) 00010000:00010000:2.0:1789043026.169254:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043026.169257:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06d4e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.169262:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06d4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.169295:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c06d40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c3a expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.169309:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06d55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c3a expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.169316:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:2.0:1789043026.169318:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789043026.169321:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50979800, rc 0) 00000100:00100000:2.0:1789043026.169383:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6ff0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+60:11621:x1875947242480512:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 653us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043026.169391:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 211 00000100:00100000:3.0:1789043026.172816:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043026.172919:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242480768 00000100:00100000:0.0:1789043026.172931:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242480768 00000100:00100000:0.0:1789043026.172988:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 212 00000100:00100000:0.0:1789043026.172996:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+60:11621:x1875947242480768:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:0.0:1789043026.173015:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789043026.173034:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c06d5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676c41 expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.173161:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06d63 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.173175:0:11703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06d2b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c2c expref: 61 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.173183:0:11703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06d55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c3a expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.173191:0:11703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06d63 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.173221:0:11703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06d55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c3a expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.173234:0:11703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06d55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c3a expref: 61 pid: 5845 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043026.173246:0:11703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6ff0df80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11703:1875947267636608:192.168.203.17@tcp:104: 00010000:00010000:0.0:1789043026.173347:0:11703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06d2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c2c expref: 61 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.173355:0:11703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06d2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c2c expref: 61 pid: 11703 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043026.173362:0:11703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6ff0c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11703:1875947267636736:192.168.203.17@tcp:104: 00000100:00100000:0.0:1789043026.173390:0:11703:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a52c30300 going to sleep for 11 seconds 00000100:00100000:3.0:1789043026.178599:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043026.178699:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242480896 00000100:00100000:2.0:1789043026.178709:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242480896 00010000:00010000:2.0:1789043026.178748:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06d55 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c3a expref: 62 pid: 5845 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043026.178813:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 81 00000100:00100000:2.0:1789043026.178824:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+62:2352:x1875947242480896:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789043026.178849:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789043026.178856:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06d55 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c3a expref: 62 pid: 5845 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.178869:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06d55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c3a expref: 62 pid: 5845 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.178891:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:2.0:1789043026.178897:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06d63 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.178905:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06d63 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.178912:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789043026.178964:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+62:2352:x1875947242480896:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 142us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043026.178971:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 81 00000100:00100000:2.0:1789043026.182242:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043026.182580:0:11703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6ff0c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11703:1875947267636736:192.168.203.17@tcp:104: 00000100:00100000:3.0:1789043026.182681:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242481024 00000100:00100000:3.0:1789043026.182690:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242481024 00010000:00010000:3.0:1789043026.182725:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06d2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c2c expref: 62 pid: 11703 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043026.182765:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 82 00000100:00100000:3.0:1789043026.182792:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+62:2351:x1875947242481024:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789043026.182807:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789043026.182814:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06d2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c2c expref: 62 pid: 11703 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.182826:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06d2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c2c expref: 62 pid: 11703 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.182860:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06d2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c2c expref: 62 pid: 11703 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.182876:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:3.0:1789043026.182882:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06d63 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.182890:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06d63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.182898:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06d63 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.182917:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789043026.182970:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+61:2351:x1875947242481024:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 181us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043026.182977:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 82 00010000:00010000:0.0:1789043026.188008:0:11703:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.17@tcp) returned -22 from blocking AST (req@000000003bccbce9 x1875947267636608) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06d55 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c3a expref: 60 pid: 5845 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.188034:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06d55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c3a expref: 60 pid: 5845 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043026.188052:0:11703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6ff0df80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11703:1875947267636608:192.168.203.17@tcp:104: 00010000:00010000:0.0:1789043026.188079:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:0.0:1789043026.188089:0:11703:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06d63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.188100:0:11703:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06d63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.188105:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06d63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789043026.188128:0:11703:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789043026.188852:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c06d5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c41 expref: 61 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.188871:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06d63 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c41 expref: 60 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.188879:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:0.0:1789043026.188893:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789043026.188897:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a413a0e00, rc 0) 00000100:00100000:0.0:1789043026.189017:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+60:11621:x1875947242480768:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 16020us (16208us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1789043026.189025:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 212 00000100:00100000:0.0:1789043026.198458:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043026.201911:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242481280 00000100:00100000:2.0:1789043026.201927:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242481280 00000100:00100000:2.0:1789043026.202012:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 16 00000100:00100000:2.0:1789043026.202023:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6ff0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+60:11621:x1875947242481280:12345-192.168.203.17@tcp:103:lfs.0 00010000:00010000:2.0:1789043026.202039:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789043026.202078:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06cc2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c17 expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.202098:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:2.0:1789043026.202104:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789043026.202175:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6ff0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+59:11621:x1875947242481280:12345-192.168.203.17@tcp:103:lfs.0 Request processed in 154us (3727us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043026.202183:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 16 00000100:00100000:2.0:1789043026.213064:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043026.213180:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242481408 00000100:00100000:1.0:1789043026.213191:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242481408 00000100:00100000:1.0:1789043026.213255:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 213 00000100:00100000:1.0:1789043026.213266:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+59:11621:x1875947242481408:12345-192.168.203.17@tcp:58:lfs.0 00010000:00010000:1.0:1789043026.213551:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06d71 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.213571:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06d71 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.213583:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06d71 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789043026.213778:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1789043026.213940:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+59:11621:x1875947242481408:12345-192.168.203.17@tcp:58:lfs.0 Request processed in 673us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043026.213948:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 213 00000100:00100000:1.0:1789043026.221073:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043026.221165:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242481536 00000100:00100000:2.0:1789043026.221176:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242481536 00000100:00100000:2.0:1789043026.221263:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 214 00000100:00100000:2.0:1789043026.221273:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a77120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+59:11621:x1875947242481536:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:2.0:1789043026.221295:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043026.221330:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06d78 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676c48 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.221390:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06d71 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.221401:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06d78 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c48 expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.221421:0:5845:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06d71 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.221433:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06d78 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c48 expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.221465:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:2.0:1789043026.221469:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789043026.221474:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06d78 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c48 expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.221482:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50979400, rc 0) 00000100:00100000:2.0:1789043026.221573:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a77120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+60:11621:x1875947242481536:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 302us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043026.221580:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 214 00010000:00010000:3.0:1789043026.290894:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789043026.358183:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789043026.358193:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789043026.358253:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1789043026.358261:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789043026.358383:0:11689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a77122d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1875947267636864:192.168.203.17@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789043026.358507:0:11689:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a46eaa0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789043026.363355:0:11689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a77122d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1875947267636864:192.168.203.17@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789043026.366478:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043026.366564:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242481664 00000100:00100000:1.0:1789043026.366573:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242481664 00000100:00100000:1.0:1789043026.366635:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 215 00000100:00100000:1.0:1789043026.366646:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6ff0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+60:11624:x1875947242481664:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789043026.366677:0:11703:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789043026.366774:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6ff0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+60:11624:x1875947242481664:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 Request processed in 129us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043026.366782:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 215 00000100:00100000:1.0:1789043026.374036:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043026.374135:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242481792 00000100:00100000:2.0:1789043026.374146:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242481792 00000100:00100000:2.0:1789043026.374202:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 216 00000100:00100000:2.0:1789043026.374213:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a77120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+60:11624:x1875947242481792:12345-192.168.203.17@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789043026.374279:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06d7f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.374297:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06d7f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.374310:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06d7f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.374336:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06d86 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.374344:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06d86 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.374490:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06d86 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.374512:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06d8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.374548:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06d8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.374556:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06d8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789043026.374591:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789043026.374596:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789043026.374608:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06d8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.374618:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06d7f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.374624:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06d7f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.374631:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06d7f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.374637:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50978800 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043026.374641:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06d7f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.374649:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06d7f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.374669:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa06a44e19600) 00010000:00010000:2.0:1789043026.374672:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043026.374677:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06d7f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.374684:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06d7f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.374697:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06d86 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.374704:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06d86 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.374711:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06d86 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.374716:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979a00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043026.374720:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06d86 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.374726:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06d86 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.374733:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffffa06a457d3f00) 00010000:00010000:2.0:1789043026.374736:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043026.374739:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06d86 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.374745:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06d86 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.374770:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06d8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.374776:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06d8d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.374783:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06d8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.374789:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50978600 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043026.374792:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06d8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.374799:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06d8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.374807:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:2.0:1789043026.374810:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043026.374813:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06d8d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.374820:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06d8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043026.374904:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a77120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+60:11624:x1875947242481792:12345-192.168.203.17@tcp:34:lhsmtool_posix.0 Request processed in 691us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043026.374913:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 216 00000100:00100000:3.0:1789043026.383774:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043026.383940:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242482048 00000100:00100000:2.0:1789043026.383950:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242482048 00000100:00100000:2.0:1789043026.383998:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 217 00000100:00100000:2.0:1789043026.384015:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+60:11624:x1875947242482048:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789043026.384035:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043026.384055:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06d94 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676c4f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.384138:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06d9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.384166:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06d9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.384178:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06d9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789043026.384190:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789043026.384277:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06d9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.384286:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06d9b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.384293:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06d9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.384299:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979a00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043026.384303:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06d9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.384311:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06d9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.384323:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:2.0:1789043026.384332:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789043026.384337:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06d9b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.384344:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06d9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.384457:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06d94 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c4f expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.384467:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa06a44e19600) 00010000:00010000:2.0:1789043026.384470:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789043026.384474:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06d94 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c4f expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.384483:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50978600, rc 0) 00000100:00100000:2.0:1789043026.384570:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+61:11624:x1875947242482048:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 556us (803us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1789043026.384578:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 217 00000100:00100000:0.0:1789043026.396642:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043026.396751:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242482176 00000100:00100000:2.0:1789043026.396761:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242482176 00000100:00100000:2.0:1789043026.396820:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 218 00000100:00100000:2.0:1789043026.396830:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6ff0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+61:11624:x1875947242482176:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789043026.396875:0:6714:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789043026.396972:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6ff0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+61:11624:x1875947242482176:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 Request processed in 143us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043026.396980:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 218 00000100:00100000:3.0:1789043026.400015:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043026.400585:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242482432 00000100:00100000:2.0:1789043026.400607:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242482432 00000100:00100000:2.0:1789043026.400661:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 219 00000100:00100000:2.0:1789043026.400670:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+61:11624:x1875947242482432:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789043026.400691:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043026.400695:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789043026.400720:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c06d39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c33 expref: 61 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.400738:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa06a457d3100) 00010000:00010000:2.0:1789043026.400743:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789043026.400755:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06da9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676c56 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789043026.401125:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1789043026.402716:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06db0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.402736:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06db0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.402749:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06db0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.402821:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06da9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c56 expref: 63 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.402849:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06db0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c56 expref: 62 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.402879:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa06a457d3f00) 00010000:00010000:2.0:1789043026.402881:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789043026.402884:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50979a00, rc 0) 00000100:00100000:2.0:1789043026.402958:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+62:11624:x1875947242482432:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 2287us (2951us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1789043026.402965:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 219 00000100:00100000:3.0:1789043026.407079:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043026.407202:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242482688 00000100:00100000:0.0:1789043026.407213:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242482688 00000100:00100000:0.0:1789043026.407259:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 220 00000100:00100000:0.0:1789043026.407269:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+62:11624:x1875947242482688:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789043026.407346:0:11703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789043026.407373:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979a00/0x99260d7389c06db0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c56 expref: 62 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.407393:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa06a457d3f00) 00010000:00010000:0.0:1789043026.407403:0:11703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789043026.407421:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c06dbe lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.407434:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c06dbe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.407444:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c06dbe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.407458:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c06dc5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xb35668e6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.407483:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c06dc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb35668e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.407491:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c06dc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb35668e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.407565:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c06dbe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.407574:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c06dbe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.407582:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c06dbe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.407588:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a413a0600 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789043026.407593:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c06dbe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.407602:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c06dbe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.407610:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa06a457d3100) 00010000:00010000:0.0:1789043026.407613:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789043026.407618:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c06dbe lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.407624:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0600/0x99260d7389c06dbe lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.407633:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c06dc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb35668e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.407645:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c06dc5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb35668e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.407651:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c06dc5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb35668e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.407656:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a413a0800 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789043026.407659:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c06dc5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb35668e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.407666:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c06dc5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb35668e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.407674:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xb35668e6 (ffffa06a55221b00) 00010000:00010000:0.0:1789043026.407677:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789043026.407679:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c06dc5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb35668e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.407685:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0800/0x99260d7389c06dc5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb35668e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043026.407760:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+61:11624:x1875947242482688:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 Request processed in 491us (689us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789043026.407768:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 220 00000100:00100000:3.0:1789043026.412804:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043026.413862:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242482816 00000100:00100000:2.0:1789043026.413876:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242482816 00000100:00100000:2.0:1789043026.413944:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 221 00000100:00100000:2.0:1789043026.413954:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+61:11624:x1875947242482816:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789043026.413975:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043026.413998:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06dcc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676c5d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.414157:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06dd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.414171:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.414183:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.415133:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978800/0x99260d7389c06dcc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c5d expref: 63 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.415159:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06dd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c5d expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.415178:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa06a457d3200) 00010000:00010000:2.0:1789043026.415181:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789043026.415185:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50978e00, rc 0) 00000100:00100000:2.0:1789043026.415326:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+62:11624:x1875947242482816:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 1372us (2531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043026.415333:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 221 00000100:00100000:3.0:1789043026.426509:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043026.426598:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242483072 00000100:00100000:1.0:1789043026.426608:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242483072 00000100:00100000:1.0:1789043026.426676:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 222 00000100:00100000:1.0:1789043026.426686:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+62:11624:x1875947242483072:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789043026.426760:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06dda lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.426777:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06dda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.426801:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06dda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789043026.427042:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:1.0:1789043026.427127:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000763481d2 reply state 00000000b44e2f80 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06dda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043026.427137:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789043026.430135:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+64:11624:x1875947242483072:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 Request processed in 3438us (3622us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1789043026.430148:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 222 00010000:00010000:1.0:1789043026.432748:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06dda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.432764:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06dda lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.432772:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06dda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.432778:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043026.432782:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06dda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.432789:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06dda lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.432804:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa06a457d3200) 00010000:00010000:1.0:1789043026.432807:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789043026.432812:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06dda lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.432831:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06dda lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043026.441404:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043026.441449:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242483200 00000100:00100000:3.0:1789043026.441459:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242483200 00000100:00100000:3.0:1789043026.441542:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 223 00000100:00100000:3.0:1789043026.441552:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+63:11624:x1875947242483200:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789043026.441575:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789043026.441597:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06de1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676c64 expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.441658:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06de1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c64 expref: 64 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.441675:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06de1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c64 expref: 64 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.441695:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa06a457d3200) 00010000:00010000:3.0:1789043026.441699:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789043026.441703:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc28800, rc 0) 00000100:00100000:3.0:1789043026.441768:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+64:11624:x1875947242483200:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 218us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043026.441775:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 223 00000100:00100000:3.0:1789043026.444876:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043026.445170:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242483328 00000100:00100000:1.0:1789043026.445181:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242483328 00000100:00100000:1.0:1789043026.445238:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 62 00000100:00100000:1.0:1789043026.445249:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+9:2349:x1875947242483328:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789043026.445751:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+10:2349:x1875947242483328:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 Request processed in 502us (882us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1789043026.445759:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 62 00000100:00100000:2.0:1789043026.449354:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043026.450044:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242483584 00000100:00100000:0.0:1789043026.450054:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242483584 00000100:00100000:0.0:1789043026.450196:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 60 00000100:00100000:0.0:1789043026.450207:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+64:11624:x1875947242483584:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789043026.450438:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+65:11624:x1875947242483584:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 Request processed in 232us (1093us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1789043026.450459:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 60 00000100:00100000:2.0:1789043026.453924:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043026.454149:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242483840 00000100:00100000:3.0:1789043026.454158:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242483840 00000100:00100000:3.0:1789043026.454212:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 224 00000100:00100000:3.0:1789043026.454236:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+65:11624:x1875947242483840:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789043026.454576:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+65:11624:x1875947242483840:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 Request processed in 341us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043026.454584:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 224 00000100:00100000:3.0:1789043026.458800:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043026.458953:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242483968 00000100:00100000:1.0:1789043026.458964:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242483968 00000100:00100000:1.0:1789043026.459025:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 225 00000100:00100000:1.0:1789043026.459035:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+65:11624:x1875947242483968:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789043026.459055:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043026.459075:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06de8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676c6b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.459138:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06def lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.459152:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06def lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.459164:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06def lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789043026.459197:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789043026.459229:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06def lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.459252:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06de8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c6b expref: 67 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.459268:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06def lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c6b expref: 66 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.459277:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa06a457d3200) 00010000:00010000:1.0:1789043026.459279:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789043026.459283:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41686e00, rc 0) 00000100:00100000:1.0:1789043026.459355:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+66:11624:x1875947242483968:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 321us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043026.459363:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 225 00000100:00100000:2.0:1789043026.462127:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043026.462206:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242484096 00000100:00100000:3.0:1789043026.462215:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242484096 00000100:00100000:3.0:1789043026.462264:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 63 00000100:00100000:3.0:1789043026.462274:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+10:2352:x1875947242484096:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789043026.462291:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789043026.462324:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd91f474/0x99260d7389c06df6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676c72 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789043026.462351:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa2a152, blocks: 0x1 00010000:00010000:3.0:1789043026.462367:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=369s v=(0 0) 00010000:00010000:3.0:1789043026.462372:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789043026.462380:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd91f474/0x99260d7389c06df6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c72 expref: 11 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.462396:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cd91f474/0x99260d7389c06df6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c72 expref: 11 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.462409:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc29200, rc 0) 00000100:00100000:3.0:1789043026.462464:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+11:2352:x1875947242484096:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 191us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043026.462487:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 63 00000100:00100000:3.0:1789043026.467743:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043026.467993:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242484352 00000100:00100000:2.0:1789043026.468004:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242484352 00000100:00100000:2.0:1789043026.468061:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 226 00000100:00100000:2.0:1789043026.468072:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+66:11624:x1875947242484352:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789043026.468197:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+66:11624:x1875947242484352:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 Request processed in 126us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043026.468204:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 226 00000100:00100000:0.0:1789043026.471866:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043026.471986:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242484480 00000100:00100000:2.0:1789043026.471995:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242484480 00000100:00100000:2.0:1789043026.472047:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 64 00000100:00100000:2.0:1789043026.472057:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6ff0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+11:11624:x1875947242484480:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789043026.472075:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043026.472093:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9e892b0/0x99260d7389c06dfd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676c79 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.472157:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cd91f474/0x99260d7389c06df6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c72 expref: 12 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.472166:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789043026.472171:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789043026.472175:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9e892b0/0x99260d7389c06dfd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c79 expref: 12 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.472204:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cd91f474/0x99260d7389c06df6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c72 expref: 12 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.472217:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cd91f474/0x99260d7389c06df6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c72 expref: 12 pid: 6690 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043026.472230:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767eed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6692:1875947267636992:192.168.203.17@tcp:104: 00000100:00100000:2.0:1789043026.472322:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a46f1e840 going to sleep for 11 seconds 00000100:00100000:2.0:1789043026.477015:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043026.477083:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242484608 00000100:00100000:0.0:1789043026.477093:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242484608 00010000:00010000:0.0:1789043026.477142:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cd91f474/0x99260d7389c06df6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c72 expref: 13 pid: 6690 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043026.477192:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 83 00000100:00100000:0.0:1789043026.477202:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+13:2352:x1875947242484608:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789043026.477217:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789043026.477238:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cd91f474/0x99260d7389c06df6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c72 expref: 13 pid: 6690 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.477252:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cd91f474/0x99260d7389c06df6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c72 expref: 13 pid: 6690 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.477276:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043026.477281:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043026.477291:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9e892b0/0x99260d7389c06dfd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c79 expref: 13 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.477301:0:8457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9e892b0/0x99260d7389c06dfd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c79 expref: 13 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.477344:0:8457:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e9e892b0/0x99260d7389c06dfd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c79 expref: 13 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043026.477373:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6ff0e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8457:1875947267637120:192.168.203.17@tcp:105: 00000100:00100000:0.0:1789043026.477459:0:8457:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a52c30300 going to sleep for 11 seconds 00010000:00010000:3.0:1789043026.478370:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd91f474/0x99260d7389c06df6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c72 expref: 13 pid: 6690 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043026.478388:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767eed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6692:1875947267636992:192.168.203.17@tcp:104: 00010000:00010000:3.0:1789043026.478410:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e9e892b0/0x99260d7389c06dfd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c79 expref: 12 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.478422:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50978a00, rc 0) 00000100:00100000:3.0:1789043026.478478:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6ff0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+12:11624:x1875947242484480:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 6422us (6621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043026.478486:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 64 00000100:00100000:0.0:1789043026.485686:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6ff0e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8457:1875947267637120:192.168.203.17@tcp:105: 00010000:00010000:0.0:1789043026.485712:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789043026.485764:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+11:2352:x1875947242484608:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 8562us (8757us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043026.485774:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 83 00000100:00100000:0.0:1789043026.489697:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043026.489826:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242484736 00000100:00100000:3.0:1789043026.489845:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242484736 00002000:00100000:3.0:1789043026.489891:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffffa06a6ff0e680 x1875947242484736/t0(0) o4->3fb32839-ebfd-4c0f-90e4-f036c86704df@192.168.203.17@tcp:322/0 lens 504/0 e 0 to 0 dl 1789043037 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789043026.489902:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa06a6ff0e680 with x1875947242484736 ext(0->12) 00002000:00010000:3.0:1789043026.489907:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa06a6ff0e680 00000100:00100000:3.0:1789043026.489941:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 6 00000100:00100000:3.0:1789043026.489950:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6ff0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+11:2352:x1875947242484736:12345-192.168.203.17@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789043026.490465:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6ff0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+13:2352:x1875947242484736:12345-192.168.203.17@tcp:4:lhsmtool_posix.0 Request processed in 513us (774us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1789043026.490473:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 6 00002000:00100000:3.0:1789043026.490488:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffffa06a6ff0e680 x1875947242484736/t4294967320(0) o4->3fb32839-ebfd-4c0f-90e4-f036c86704df@192.168.203.17@tcp:322/0 lens 504/448 e 0 to 0 dl 1789043037 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789043026.490497:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa06a6ff0e680 with x1875947242484736 ext(0->12) 00002000:00010000:3.0:1789043026.490500:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa06a6ff0e680 00000100:00100000:2.0:1789043026.494786:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043026.494889:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242484864 00000100:00100000:3.0:1789043026.494899:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242484864 00000100:00100000:3.0:1789043026.494997:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 227 00000100:00100000:3.0:1789043026.495008:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+66:11624:x1875947242484864:12345-192.168.203.17@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789043026.531586:0:12528:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:0.0:1789043026.531742:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa06a7f8ce9c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1789043026.531748:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa06a505ddb00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa06a7f8ce000 00000020:00080000:0.0:1789043026.531752:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa06a505ddd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa06a6f000000 00000020:00080000:0.0:1789043026.531791:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:0.0:1789043026.531810:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:0.0:1789043026.531860:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:0.0:1789043026.531880:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1789043026.531890:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1789043026.532069:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6ff0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267637248:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789043026.532128:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1789043026.532200:0:12528:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa06a52c30000 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1789043026.532205:0:12528:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa06a81706500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa06a52c30c00 00000020:00080000:1.0:1789043026.532209:0:12528:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa06a81706800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa06a55a72400 00000100:00100000:2.0:1789043026.532784:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+20:11624:x1875947242484864:12345-192.168.203.17@tcp:44:lhsmtool_posix.0 Request processed in 37774us (38004us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043026.532794:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 227 00000100:00100000:0.0:1789043026.532945:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a772b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267637376:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789043026.532972:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043026.533047:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267637248 00000100:00100000:1.0:1789043026.533054:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267637248 00000100:00100000:1.0:1789043026.533114:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789043026.533127:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3315:x1875947267637248:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789043026.533160:0:6690:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:1.0:1789043026.533192:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa2a151, atime: 0x6aa2a152, ctime: 0x6aa2a151, blocks: 0x1 00010000:00010000:1.0:1789043026.533201:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000504581/0x99260d7389c06e04 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.533231:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=369s v=(0 0) 00010000:00010000:1.0:1789043026.533236:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789043026.533242:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000504581/0x99260d7389c06e04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.533257:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000504581/0x99260d7389c06e04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.533267:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000504581/0x99260d7389c06e04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.533274:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000504581/0x99260d7389c06e04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.533291:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789043026.534092:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3315:x1875947267637248:12345-0@lo:6:osp-syn-0-0.0 Request processed in 967us (1961us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789043026.534100:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:1.0:1789043026.534123:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789043026.534129:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000504581/0x99260d7389c06e04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789043026.534228:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa06a6ff0d500/2, rc 0, transno 4294967310 00000100:00100000:3.0:1789043026.534235:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6ff0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267637248:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789043026.534274:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687200 already unused, calling callback (ffffffffc1470760) 00010000:00010000:1.0:1789043026.534279:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000504581/0x99260d7389c06e04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.534314:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000504581/0x99260d7389c06e04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.534330:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000504581/0x99260d7389c06e04 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.534339:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000504581/0x99260d7389c06e04 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.534358:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043026.534360:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043026.534362:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789043026.534496:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:1.0:1789043026.535394:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1789043026.535567:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1789043026.537966:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267637376 00000100:00100000:1.0:1789043026.537981:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267637376 00000100:00100000:1.0:1789043026.538058:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789043026.538072:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1875947267637376:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789043026.538101:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:1.0:1789043026.538126:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c06e0b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.538147:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000075963653/0x99260d7389c06bc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bd8 expref: 12 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.538157:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789043026.538174:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789043026.538179:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c06e0b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.538214:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000075963653/0x99260d7389c06bc6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bd8 expref: 12 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.538229:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000075963653/0x99260d7389c06bc6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bd8 expref: 12 pid: 6691 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043026.538243:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a77122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6691:1875947267637504:192.168.203.17@tcp:104: 00000100:00080000:2.0:1789043026.538472:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789043026.538535:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a46eaa480 going to sleep for 11 seconds 00000100:00100000:2.0:1789043026.541870:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043026.541992:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043026.542086:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242485120 00000100:00100000:0.0:1789043026.542096:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242485120 00010000:00010000:0.0:1789043026.542133:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000075963653/0x99260d7389c06bc6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bd8 expref: 13 pid: 6691 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043026.542187:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 84 00000100:00100000:0.0:1789043026.542198:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+13:2352:x1875947242485120:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789043026.542214:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789043026.542220:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000075963653/0x99260d7389c06bc6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bd8 expref: 13 pid: 6691 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.542234:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000075963653/0x99260d7389c06bc6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bd8 expref: 13 pid: 6691 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.542257:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789043026.542262:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789043026.542268:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c06e0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.542278:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c06e0b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.542298:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789043026.542473:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+13:2352:x1875947242485120:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 275us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043026.542480:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 84 00010000:00010000:1.0:1789043026.543291:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075963653/0x99260d7389c06bc6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bd8 expref: 12 pid: 6691 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043026.543320:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a77122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6691:1875947267637504:192.168.203.17@tcp:104: 00010000:00010000:1.0:1789043026.543348:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c06e0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.543359:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c06e0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.543366:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c06e0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.543376:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c06e0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.543395:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c06e0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.543410:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789043026.544226:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3312:x1875947267637376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6157us (11250us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1789043026.544237:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789043026.544259:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242484992 00000100:00100000:1.0:1789043026.544264:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242484992 00010000:00010000:0.0:1789043026.545201:0:11175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789043026.545211:0:11175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c06e0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.545240:0:11175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687e00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789043026.545244:0:11175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c06e0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.545255:0:11175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c06e0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.545275:0:11175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c06e0b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.545283:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c06e0b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.545323:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043026.545326:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043026.545327:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789043026.545364:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa06a772b5180/2, rc 0, transno 4294967321 00000100:00100000:0.0:1789043026.545381:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a772b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267637376:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789043026.545749:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 67 00000100:00100000:3.0:1789043026.545761:0:8215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+12:2349:x1875947242484992:12345-192.168.203.17@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1789043026.576154:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:1.0:1789043026.576173:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:1.0:1789043026.576179:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:1.0:1789043026.576187:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:2.0:1789043026.576378:0:8215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2349:x1875947242484992:12345-192.168.203.17@tcp:16:lhsmtool_posix.0 Request processed in 30614us (34511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043026.576390:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 67 00000100:00100000:2.0:1789043026.580581:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043026.580719:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242485376 00000100:00100000:1.0:1789043026.580729:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242485376 00000100:00100000:1.0:1789043026.580795:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 228 00000100:00100000:1.0:1789043026.580806:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+20:11624:x1875947242485376:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789043026.580866:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789043026.580895:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06def lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c6b expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.580913:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa06a457d3200) 00010000:00010000:1.0:1789043026.580919:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789043026.580949:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06e12 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.580964:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06e12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.580988:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06e12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789043026.581218:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cecb5f8c reply state 000000006a096862 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06e12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043026.581228:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789043026.581332:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+21:11624:x1875947242485376:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 Request processed in 527us (758us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1789043026.581340:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 228 00010000:00010000:2.0:1789043026.584070:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06e12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.584086:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06e12 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.584092:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06e12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.584099:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043026.584103:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06e12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.584110:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06e12 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.584128:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa06a457d3200) 00010000:00010000:2.0:1789043026.584131:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043026.584136:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06e12 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.584143:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06e12 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043026.586178:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043026.587089:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242485504 00000100:00100000:0.0:1789043026.587101:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242485504 00000100:00100000:0.0:1789043026.587161:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 68 00000100:00100000:0.0:1789043026.587171:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2352:x1875947242485504:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789043026.587426:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789043026.587430:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789043026 00002000:00010000:0.0:1789043026.587432:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789043026 00002000:00010000:0.0:1789043026.587447:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789043026 -> 1789043026 00002000:00010000:0.0:1789043026.587449:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789043026.587746:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:2352:x1875947242485504:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 Request processed in 575us (1577us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1789043026.587755:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 68 00000100:00100000:2.0:1789043026.594032:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043026.594125:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242485760 00000100:00100000:0.0:1789043026.594135:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242485760 00000100:00100000:0.0:1789043026.594217:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 229 00000100:00100000:0.0:1789043026.594228:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+20:11624:x1875947242485760:12345-192.168.203.17@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789043026.594295:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a7fa6e000/0x99260d7389c06e19 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.594434:0:11703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06dd3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c5d expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.594444:0:11703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a7fa6e000/0x99260d7389c06e19 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.594478:0:11703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06dd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c5d expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.594492:0:11703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06dd3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c5d expref: 20 pid: 5845 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043026.594506:0:11703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a772b7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11703:1875947267637632:192.168.203.17@tcp:104: 00000100:00100000:0.0:1789043026.594607:0:11703:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7a86bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789043026.598778:0:11703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a772b7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11703:1875947267637632:192.168.203.17@tcp:104: 00010000:00010000:0.0:1789043026.598827:0:11703:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa06a7fa6e000/0x99260d7389c06e19 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043026.599071:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043026.599784:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242485888 00000100:00100000:0.0:1789043026.599794:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242485888 00010000:00010000:0.0:1789043026.599830:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06dd3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c5d expref: 21 pid: 5845 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043026.599874:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 85 00000100:00100000:0.0:1789043026.599884:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+21:2351:x1875947242485888:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789043026.599899:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789043026.599907:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06dd3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c5d expref: 21 pid: 5845 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.599919:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06dd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c5d expref: 21 pid: 5845 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.599943:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978e00/0x99260d7389c06dd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c5d expref: 21 pid: 5845 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.599958:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa06a457d3200) 00010000:00010000:0.0:1789043026.599963:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a7fa6e000/0x99260d7389c06e19 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.599973:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a7fa6e000/0x99260d7389c06e19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.599980:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a7fa6e000/0x99260d7389c06e19 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.600021:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789043026.600070:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+20:2351:x1875947242485888:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 186us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043026.600078:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 85 00010000:00010000:2.0:1789043026.600330:0:11703:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa06a7fa6e000/0x99260d7389c06e19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.600346:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a7fa6e000/0x99260d7389c06e19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.600375:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a7fa6e000/0x99260d7389c06e19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.600382:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a7fa6e000/0x99260d7389c06e19 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.600389:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a7fa6e000/0x99260d7389c06e19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.600395:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a7fa6e000 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043026.600399:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a7fa6e000/0x99260d7389c06e19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.600408:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a7fa6e000/0x99260d7389c06e19 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.600417:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa06a457d3200) 00010000:00010000:2.0:1789043026.600420:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789043026.600424:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a7fa6e000/0x99260d7389c06e19 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.600431:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a7fa6e000/0x99260d7389c06e19 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043026.601055:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+19:11624:x1875947242485760:12345-192.168.203.17@tcp:55:lhsmtool_posix.0 Request processed in 6827us (7031us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789043026.601065:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 229 00000100:00100000:3.0:1789043026.605401:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043026.605556:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242486016 00000100:00100000:1.0:1789043026.605566:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242486016 00000100:00100000:1.0:1789043026.605741:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 69 00000100:00100000:1.0:1789043026.605754:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:2352:x1875947242486016:12345-192.168.203.17@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789043026.605799:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000060afe72c/0x99260d7389c06e20 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.605821:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9e892b0/0x99260d7389c06dfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c79 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.605829:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789043026.605843:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789043026.605848:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060afe72c/0x99260d7389c06e20 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.605885:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e9e892b0/0x99260d7389c06dfd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c79 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.605918:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e9e892b0/0x99260d7389c06dfd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c79 expref: 8 pid: 6692 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043026.605933:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a77122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6690:1875947267637760:192.168.203.17@tcp:104: 00000100:00100000:1.0:1789043026.606017:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a52c30f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789043026.610564:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a77122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6690:1875947267637760:192.168.203.17@tcp:104: 00010000:00010000:1.0:1789043026.610600:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000060afe72c/0x99260d7389c06e20 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043026.611978:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043026.612058:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242486144 00000100:00100000:1.0:1789043026.612067:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242486144 00010000:00010000:1.0:1789043026.612107:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e9e892b0/0x99260d7389c06dfd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c79 expref: 9 pid: 6692 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043026.612157:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 86 00000100:00100000:1.0:1789043026.612169:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+9:2351:x1875947242486144:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789043026.612183:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789043026.612206:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e9e892b0/0x99260d7389c06dfd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c79 expref: 9 pid: 6692 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.612220:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e9e892b0/0x99260d7389c06dfd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c79 expref: 9 pid: 6692 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.612241:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9e892b0/0x99260d7389c06dfd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c79 expref: 9 pid: 6692 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.612270:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789043026.612274:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789043026.612280:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000060afe72c/0x99260d7389c06e20 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.612291:0:8457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060afe72c/0x99260d7389c06e20 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.612330:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789043026.612382:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:2351:x1875947242486144:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 215us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043026.612389:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 86 00010000:00010000:3.0:1789043026.612956:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000060afe72c/0x99260d7389c06e20 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.612969:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060afe72c/0x99260d7389c06e20 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.612995:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000060afe72c/0x99260d7389c06e20 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.613003:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060afe72c/0x99260d7389c06e20 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.613025:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060afe72c/0x99260d7389c06e20 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.613032:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686e00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:3.0:1789043026.613036:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060afe72c/0x99260d7389c06e20 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.613045:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060afe72c/0x99260d7389c06e20 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.613057:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060afe72c/0x99260d7389c06e20 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.613066:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060afe72c/0x99260d7389c06e20 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043026.613131:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2352:x1875947242486016:12345-192.168.203.17@tcp:1:lhsmtool_posix.0 Request processed in 7379us (7738us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043026.613140:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 69 00000100:00100000:0.0:1789043026.618024:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043026.618104:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242486400 00000100:00100000:2.0:1789043026.618114:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242486400 00000100:00100000:2.0:1789043026.618170:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 230 00000100:00100000:2.0:1789043026.618180:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+19:11624:x1875947242486400:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789043026.618254:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c06e27 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.618271:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c06e27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.618284:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c06e27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.618708:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06e2e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.618722:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06de1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c64 expref: 20 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.618731:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06e2e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.618891:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06de1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c64 expref: 20 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.618906:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06de1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c64 expref: 20 pid: 6714 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043026.618942:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f873100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875947267637888:192.168.203.17@tcp:104: 00000100:00100000:3.0:1789043026.619024:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a585ae600 going to sleep for 11 seconds 00000100:00100000:3.0:1789043026.622224:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f873100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875947267637888:192.168.203.17@tcp:104: 00010000:00010000:3.0:1789043026.622253:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06e2e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043026.624320:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043026.624592:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242486528 00000100:00100000:2.0:1789043026.624603:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242486528 00010000:00010000:2.0:1789043026.624762:0:6705:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06de1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c64 expref: 21 pid: 6714 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043026.624804:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 87 00000100:00100000:2.0:1789043026.624814:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46f89450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+21:2352:x1875947242486528:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789043026.624829:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789043026.624858:0:6705:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06de1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c64 expref: 21 pid: 6714 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.624871:0:6705:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06de1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c64 expref: 21 pid: 6714 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.624894:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28800/0x99260d7389c06de1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c64 expref: 21 pid: 6714 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.624910:0:6705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa06a457d3200) 00010000:00010000:2.0:1789043026.624916:0:6705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06e2e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.624925:0:6705:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06e2e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.624933:0:6705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06e2e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.624965:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789043026.625027:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46f89450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+20:2352:x1875947242486528:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 214us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043026.625035:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 87 00010000:00010000:3.0:1789043026.625318:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06e2e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.625327:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06e2e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789043026.625566:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1789043026.627674:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1789043026.627745:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1789043026.627855:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a772b6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5845:1875947267638016:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789043026.627918:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043026.627958:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a79a3a000 going to sleep for 11 seconds 00000100:00100000:3.0:1789043026.628123:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267638016 00000100:00100000:3.0:1789043026.628131:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267638016 00000100:00100000:3.0:1789043026.628183:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789043026.628192:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1875947267638016:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789043026.628271:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1875947267638016:12345-0@lo:1000:mdt00_000.0 Request processed in 80us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043026.628279:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789043026.628509:0:5845:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:0.0:1789043026.628602:0:5845:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:0.0:1789043026.628678:0:5845:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa06a772b5180, transno 4294967321 00000100:00100000:0.0:1789043026.628697:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a772b6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5845:1875947267638016:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1789043026.629145:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1789043026.629208:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a772b6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5845:1875947267638144:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789043026.629242:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043026.629271:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7a86bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789043026.629752:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267638144 00000100:00100000:3.0:1789043026.629758:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267638144 00000100:00100000:3.0:1789043026.629804:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789043026.629813:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1875947267638144:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789043026.629980:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5845:x1875947267638144:12345-0@lo:1000:mdt00_000.0 Request processed in 169us (736us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1789043026.629999:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789043026.630778:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a772b6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5845:1875947267638144:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1789043026.630814:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06e2e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.630826:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06e2e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.630857:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06e2e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.630864:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979800 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789043026.630868:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06e2e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.630875:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06e2e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.630891:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa06a457d3200) 00010000:00010000:0.0:1789043026.630894:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789043026.630899:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06e2e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.630905:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06e2e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.630935:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06d71 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.630942:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06d71 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.630948:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06d71 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.630953:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686600 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789043026.630956:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06d71 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.630973:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06d71 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.630982:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:0.0:1789043026.630984:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789043026.630991:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06d78 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c48 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.631002:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06d78 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c48 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.631011:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06d78 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c48 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.631041:0:5845:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06d78 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c48 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043026.631053:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a772b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875947267638272:192.168.203.17@tcp:105: 00000100:00100000:0.0:1789043026.631123:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a454a7000 going to sleep for 11 seconds 00000100:00100000:0.0:1789043026.635400:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043026.635538:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242486656 00000100:00100000:2.0:1789043026.635548:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242486656 00000100:00100000:2.0:1789043026.635601:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 61 00000100:00100000:2.0:1789043026.635611:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+24:11621:x1875947242486656:12345-192.168.203.17@tcp:49:lfs.0 00000100:00100000:2.0:1789043026.635747:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+24:11621:x1875947242486656:12345-192.168.203.17@tcp:49:lfs.0 Request processed in 136us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043026.635772:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 61 00000100:00100000:3.0:1789043026.637165:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a772b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875947267638272:192.168.203.17@tcp:105: 00010000:00010000:3.0:1789043026.637217:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06d71 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.637228:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06d71 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.637264:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06e35 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.637278:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06e35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.637291:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06e35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.637310:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06e35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.637324:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06e35 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.637330:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06e35 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.637336:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc29200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789043026.637340:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06e35 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.637348:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06e35 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.637373:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:3.0:1789043026.637376:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789043026.637380:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06e35 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.637385:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29200/0x99260d7389c06e35 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.637396:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c06e27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.637403:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c06e27 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.637409:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c06e27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.637414:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979600 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:3.0:1789043026.637417:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c06e27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.637424:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c06e27 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.637432:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:3.0:1789043026.637685:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789043026.637692:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c06e27 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.637699:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979600/0x99260d7389c06e27 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043026.638012:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+23:11624:x1875947242486400:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 Request processed in 19832us (19995us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1789043026.638024:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 230 00000020:00080000:3.0:1789043026.638030:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1789043026.641827:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043026.641904:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242486912 00000100:00100000:2.0:1789043026.641913:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242486912 00000100:00100000:2.0:1789043026.641963:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 62 00000100:00100000:2.0:1789043026.641972:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5ffdd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+23:11624:x1875947242486912:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789043026.643034:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789043026.643128:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1789043026.643175:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06e3c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.643191:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06e3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.643202:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06e3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.643211:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06e3c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.643218:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06e3c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.643224:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06e3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043026.643287:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789043026.643381:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5ffdd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+25:11624:x1875947242486912:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 Request processed in 1408us (1561us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1789043026.643389:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 62 00000020:00080000:2.0:1789043026.643400:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:1.0:1789043026.646038:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789043026.646047:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789043026.646914:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1789043026.646927:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789043026.647119:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043026.647875:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242487168 00000100:00100000:3.0:1789043026.647885:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242487168 00000100:00100000:3.0:1789043026.647952:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 231 00000100:00100000:3.0:1789043026.647963:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+25:11621:x1875947242487168:12345-192.168.203.17@tcp:58:lfs.0 00000040:00080000:3.0:1789043026.648201:0:6714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1789043026.648285:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+25:11621:x1875947242487168:12345-192.168.203.17@tcp:58:lfs.0 Request processed in 323us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043026.648293:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 231 00010000:00010000:0.0:1789043026.651667:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789043026.651681:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06e3c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.651692:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979200 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789043026.651696:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06e3c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.651720:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06e3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.651736:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa06a457d3700) 00010000:00010000:0.0:1789043026.651739:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789043026.651744:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06e3c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.651750:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979200/0x99260d7389c06e3c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043026.651779:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043026.651781:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043026.651783:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789043026.679036:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043026.679682:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242487296 00000100:00100000:1.0:1789043026.679692:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242487296 00000100:00100000:1.0:1789043026.679749:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 232 00000100:00100000:1.0:1789043026.679760:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+25:11626:x1875947242487296:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1789043026.679782:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043026.679801:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06e43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676c80 expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.679874:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06e4a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.679904:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06e4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.679917:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06e4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.679932:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06e51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.679940:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06e51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.679946:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06e51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.680682:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06e58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.680698:0:11703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06d63 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c41 expref: 26 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.680706:0:11703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06e58 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.680740:0:11703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06d63 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c41 expref: 26 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.680754:0:11703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06d63 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c41 expref: 26 pid: 11703 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043026.680779:0:11703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a77122d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11703:1875947267638400:192.168.203.17@tcp:104: 00000100:00100000:1.0:1789043026.680867:0:11703:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a52c30f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789043026.685916:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043026.685969:0:11703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a77122d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11703:1875947267638400:192.168.203.17@tcp:104: 00010000:00010000:1.0:1789043026.685993:0:11703:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06e58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043026.687461:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242487552 00000100:00100000:2.0:1789043026.687474:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242487552 00000100:00100000:2.0:1789043026.687737:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 63 00000100:00100000:2.0:1789043026.687748:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a77122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+27:5592:x1875947242487552:12345-192.168.203.17@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789043026.687972:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a77122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+28:5592:x1875947242487552:12345-192.168.203.17@tcp:35:ldlm_bl.0 Request processed in 224us (2060us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1789043026.687980:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 63 00000100:00100000:0.0:1789043026.691652:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043026.691721:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242487680 00000100:00100000:3.0:1789043026.691734:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242487680 00010000:00010000:3.0:1789043026.691769:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06d63 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c41 expref: 28 pid: 11703 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043026.691802:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 88 00000100:00100000:3.0:1789043026.691812:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+28:2351:x1875947242487680:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789043026.691825:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789043026.691842:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06d63 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c41 expref: 28 pid: 11703 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.691856:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06d63 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c41 expref: 28 pid: 11703 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.691894:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a413a0e00/0x99260d7389c06d63 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c41 expref: 28 pid: 11703 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.691912:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:3.0:1789043026.691917:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06e58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.691926:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.691933:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06e58 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043026.692026:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789043026.692157:0:11703:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.692166:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789043026.692210:0:11703:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789043026.692214:0:11703:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789043026.692234:0:11703:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.692245:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.692254:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06e4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.692260:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06e4a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.692266:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06e4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.692283:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686600 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043026.692288:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06e4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.692295:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06e4a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.692304:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa06a457d3100) 00010000:00010000:1.0:1789043026.692307:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043026.692310:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06e4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.692316:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c06e4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.692337:0:11703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06e51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.692343:0:11703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06e51 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.692357:0:11703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06e51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.692363:0:11703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687000 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043026.692366:0:11703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06e51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.692372:0:11703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06e51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.692392:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa06a44e19b00) 00010000:00010000:1.0:1789043026.692394:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043026.692398:0:11703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06e51 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.692403:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06e51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.692436:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686200/0x99260d7389c06e43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c80 expref: 28 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.692448:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06e58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c80 expref: 27 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043026.692454:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:1.0:1789043026.692457:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789043026.692459:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41687400, rc 0) 00000100:00100000:3.0:1789043026.692666:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+27:2351:x1875947242487680:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 853us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043026.692674:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 88 00000100:00100000:1.0:1789043026.693182:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3fb32839-ebfd-4c0f-90e4-f036c86704df+26:11626:x1875947242487296:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 13422us (14154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043026.693190:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 232 00000001:00080000:1.0:1789043026.734794:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1789043026.734824:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:1.0:1789043027.186719:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267638528:0@lo:400:kworker.0 00000100:00100000:1.0:1789043027.186824:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043027.186994:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789043027.187002:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267638912:0@lo:400:kworker.0 00000100:00100000:1.0:1789043027.187040:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043027.187040:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267638528 00000100:00100000:0.0:1789043027.187052:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267638528 00000100:00100000:1.0:1789043027.187094:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267638912 00000100:00100000:1.0:1789043027.187101:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267638912 00000100:00100000:0.0:1789043027.187116:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1789043027.187130:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267638528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789043027.187153:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789043027.187163:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a77122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267638912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789043027.187170:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789043027.187180:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a585b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875947267639040:0@lo:400:kworker.0 00000100:00100000:0.0:1789043027.187199:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267638528:12345-0@lo:400:kworker.0 Request processed in 71us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043027.187209:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1789043027.187214:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a77122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267638912:12345-0@lo:400:kworker.0 Request processed in 51us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043027.187217:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043027.187223:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789043027.187253:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267638656:0@lo:400:kworker.0 00000100:00100000:2.0:1789043027.187283:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043027.187287:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875947267638784:0@lo:400:kworker.0 00000100:00100000:2.0:1789043027.187305:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6ff0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267639168:0@lo:400:kworker.0 00000100:00100000:0.0:1789043027.187312:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267639040 00000100:00100000:1.0:1789043027.187317:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043027.187319:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267639040 00000100:00100000:2.0:1789043027.187327:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043027.187368:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267638656 00000100:00100000:1.0:1789043027.187371:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267638784 00000100:00100000:0.0:1789043027.187373:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267638656 00000100:00100000:2.0:1789043027.187374:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267639168 00000100:00100000:1.0:1789043027.187377:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267638784 00000100:00100000:2.0:1789043027.187379:0:8215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267639168 00000100:00100000:0.0:1789043027.187409:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789043027.187414:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789043027.187421:0:8215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1875947267639168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789043027.187459:0:8215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1875947267639168:12345-0@lo:400:kworker.0 Request processed in 37us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043027.187465:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789043027.187474:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789043027.187481:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267638656:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789043027.187486:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789043027.187540:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267638656:12345-0@lo:400:kworker.0 Request processed in 35us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043027.187543:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6ff0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267639168:0@lo:400:kworker.0 00000100:00100000:1.0:1789043027.187547:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789043027.187559:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789043027.187566:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875947267638784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789043027.187568:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267638656:0@lo:400:kworker.0 00000100:00100000:2.0:1789043027.187598:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000100:00100000:1.0:1789043027.187598:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875947267638784:12345-0@lo:400:kworker.0 Request processed in 33us (283us total) trans 0 rc 0/0 00000004:00080000:2.0:1789043027.187604:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa06a7f85ed80, transno 4294967307 00000100:00100000:1.0:1789043027.187604:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000004:00080000:2.0:1789043027.187615:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000100:00100000:1.0:1789043027.187630:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875947267638784:0@lo:400:kworker.0 00000004:00080000:2.0:1789043027.187632:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa06a6ff0d500, transno 4294967310 00000100:00100000:2.0:1789043027.187637:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267638912:0@lo:400:kworker.0 00000100:00100000:2.0:1789043027.187646:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267638528:0@lo:400:kworker.0 00000100:00100000:0.0:1789043027.187815:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875947267639040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789043027.189181:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875947267639040:12345-0@lo:400:kworker.0 Request processed in 1754us (1954us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043027.189196:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789043027.189230:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a585b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875947267639040:0@lo:400:kworker.0 00010000:00010000:1.0:1789043027.317881:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789043027.663840:0:12622:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789043027.663854:0:12622:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789043027.663913:0:12622:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789043027.663921:0:12622:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1789043027.698823:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789043027.698844:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789043027.698893:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789043027.698904:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789043027.699058:0:11689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a026d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1875947267639424:192.168.203.17@tcp:107:hsm_cdtr.0 00000004:00080000:0.0:1789043027.699082:0:7895:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 370655565366ns, next at 371655562669ns, rc = 0 00000100:00100000:2.0:1789043027.699202:0:11689:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a6ecd0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789043027.699224:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789043027.699236:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a772b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267639296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789043027.699427:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043027.700006:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267639296 00000100:00100000:2.0:1789043027.700019:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267639296 00000100:00100000:2.0:1789043027.700087:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789043027.700099:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875947267639296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789043027.700133:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1789043027.700208:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875947267639296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043027.700224:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789043027.701634:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a772b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267639296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789043027.705375:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043027.705486:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242487808 00000100:00100000:3.0:1789043027.705498:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242487808 00000100:00100000:3.0:1789043027.705683:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 233 00000100:00100000:3.0:1789043027.705695:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a585b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+27:11638:x1875947242487808:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789043027.705768:0:6714:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00080000:2.0:1789043027.705917:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789043027.706055:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a585b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+27:11638:x1875947242487808:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 Request processed in 361us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043027.706064:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 233 00000100:00100000:1.0:1789043027.706373:0:11689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a026d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1875947267639424:192.168.203.17@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789043027.721555:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043027.721613:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242488064 00000100:00100000:2.0:1789043027.721626:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242488064 00000100:00100000:2.0:1789043027.724604:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 234 00000100:00100000:2.0:1789043027.724632:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+26:11638:x1875947242488064:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789043027.724666:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043027.724699:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06e5f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676c87 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043027.724853:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06e66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043027.724872:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06e66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043027.724887:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06e66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789043027.724903:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789043027.725078:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979800/0x99260d7389c06e5f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c87 expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043027.725108:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06e66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c87 expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043027.725137:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:2.0:1789043027.725141:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789043027.725146:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50978600, rc 0) 00000100:00100000:2.0:1789043027.725729:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+28:11638:x1875947242488064:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 1104us (4181us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1789043027.725740:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 234 00000100:00100000:2.0:1789043027.736240:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043027.736418:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242488192 00000100:00100000:1.0:1789043027.736432:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242488192 00000100:00100000:1.0:1789043027.736557:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 17 00000100:00100000:1.0:1789043027.736571:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+28:2352:x1875947242488192:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789043027.736592:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789043027.736625:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978600/0x99260d7389c06e66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c87 expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043027.736662:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:1.0:1789043027.736669:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789043027.736743:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+27:2352:x1875947242488192:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 176us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043027.736751:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 17 00000100:00100000:2.0:1789043027.738073:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043027.738186:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242488448 00000100:00100000:1.0:1789043027.738197:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242488448 00000100:00100000:1.0:1789043027.738265:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 235 00000100:00100000:1.0:1789043027.738276:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+27:11638:x1875947242488448:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789043027.738406:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06e74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043027.738428:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06e74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043027.738444:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06e74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043027.738731:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06e74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043027.738747:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06e74 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043027.738755:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06e74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043027.738762:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687000 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043027.738768:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06e74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043027.738778:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06e74 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043027.738793:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:1.0:1789043027.738797:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789043027.738803:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06e74 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043027.738810:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c06e74 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043027.739010:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+28:11638:x1875947242488448:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 Request processed in 733us (944us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1789043027.739021:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 235 00000040:00080000:2.0:1789043027.739572:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789043027.739578:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789043027.740120:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789043027.740131:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789043027.752034:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043027.752122:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242488704 00000100:00100000:3.0:1789043027.752135:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242488704 00000100:00100000:3.0:1789043027.752239:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 64 00000100:00100000:3.0:1789043027.752253:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+28:11638:x1875947242488704:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789043027.752959:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+29:11638:x1875947242488704:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 Request processed in 703us (934us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1789043027.752969:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 64 00000100:00100000:1.0:1789043028.175116:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043028.175876:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242488832 00000100:00100000:2.0:1789043028.175893:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242488832 00000100:00100000:2.0:1789043028.177757:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 300 00000100:00100000:2.0:1789043028.177787:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2351:x1875947242488832:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1789043028.177922:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2351:x1875947242488832:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 150us (2834us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043028.177931:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 300 00000100:00100000:3.0:1789043028.181317:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043028.181377:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043028.181409:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043028.181438:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043028.181486:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242489216 00000100:00100000:3.0:1789043028.181499:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242489216 00000100:00100000:3.0:1789043028.181605:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242489088 00000100:00100000:3.0:1789043028.181608:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242489088 00000100:00100000:3.0:1789043028.181636:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 97 00000100:00100000:3.0:1789043028.181649:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f871c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2352:x1875947242489216:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1789043028.181745:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f871c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2352:x1875947242489216:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 99us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043028.181753:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 97 00000100:00100000:3.0:1789043028.181772:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 98 00000100:00100000:3.0:1789043028.181779:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f870380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2352:x1875947242489088:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1789043028.181803:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f870380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2352:x1875947242489088:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 25us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043028.181809:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 98 00000100:00080000:3.0:1789043028.181847:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789043028.181852:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789043028.182014:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242488960 00000100:00100000:3.0:1789043028.182019:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242488960 00000100:00100000:3.0:1789043028.182056:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242489344 00000100:00100000:3.0:1789043028.182060:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242489344 00000100:00100000:3.0:1789043028.182089:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 163 00000100:00100000:3.0:1789043028.182116:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+29:2351:x1875947242488960:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1789043028.182158:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+29:2351:x1875947242488960:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 44us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043028.182165:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 163 00000100:00100000:3.0:1789043028.182178:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 164 00000100:00100000:3.0:1789043028.182185:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2352:x1875947242489344:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1789043028.182209:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2352:x1875947242489344:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 25us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043028.182216:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 164 00000100:00080000:3.0:1789043028.182236:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789043028.339465:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789043029.247085:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789043029.247117:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a8b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267639552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789043029.247213:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043029.247347:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267639552 00000100:00100000:2.0:1789043029.247358:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267639552 00000100:00100000:2.0:1789043029.247449:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789043029.247460:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267639552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789043029.247533:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789043029.247591:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267639552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043029.247599:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789043029.247651:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a8b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267639552:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789043029.248140:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789043029.362792:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789043029.686487:0:12674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789043029.686503:0:12674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789043029.686641:0:12674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789043029.686720:0:12674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1789043029.819879:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789043029.819890:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789043029.819924:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789043029.819930:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789043029.887339:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043029.887420:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242489600 00000100:00100000:1.0:1789043029.887430:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242489600 00000100:00100000:1.0:1789043029.887582:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 236 00000100:00100000:1.0:1789043029.887597:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6ff0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+29:11659:x1875947242489600:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1789043029.887617:0:6714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043029.887638:0:6714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06e7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676c8e expref: -99 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043029.887732:0:6714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06e82 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043029.887747:0:6714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06e82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043029.887758:0:6714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06e82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789043029.887770:0:6714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789043029.887901:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686e00/0x99260d7389c06e7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c8e expref: 32 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043029.887918:0:6714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06e82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c8e expref: 31 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043029.887926:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:1.0:1789043029.887929:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789043029.887943:0:6714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41687200, rc 0) 00000100:00100000:1.0:1789043029.887999:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6ff0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+31:11659:x1875947242489600:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 408us (669us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1789043029.888006:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 236 00000100:00080000:2.0:1789043029.888072:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789043029.893373:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043029.893454:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242489728 00000100:00100000:0.0:1789043029.893468:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242489728 00000100:00100000:0.0:1789043029.893551:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 237 00000100:00100000:0.0:1789043029.893560:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a8b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+31:11659:x1875947242489728:12345-192.168.203.17@tcp:54:lfs.0 00010000:00010000:0.0:1789043029.893622:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a7fa6f000/0x99260d7389c06e90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043029.893639:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a7fa6f000/0x99260d7389c06e90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043029.893651:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a7fa6f000/0x99260d7389c06e90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043029.893675:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a7fa6f000/0x99260d7389c06e90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043029.893681:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a7fa6f000/0x99260d7389c06e90 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043029.893687:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a7fa6f000/0x99260d7389c06e90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043029.893693:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a7fa6f000 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789043029.893696:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a7fa6f000/0x99260d7389c06e90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043029.893703:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a7fa6f000/0x99260d7389c06e90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043029.893714:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:0.0:1789043029.893729:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789043029.893734:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a7fa6f000/0x99260d7389c06e90 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043029.893742:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a7fa6f000/0x99260d7389c06e90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043029.893827:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a8b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+31:11659:x1875947242489728:12345-192.168.203.17@tcp:54:lfs.0 Request processed in 268us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043029.893834:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 237 00000100:00100000:1.0:1789043029.996444:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043029.996510:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242489856 00000100:00100000:3.0:1789043029.996557:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242489856 00000100:00100000:3.0:1789043029.996614:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 70 00000100:00100000:3.0:1789043029.996624:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2349:x1875947242489856:12345-192.168.203.17@tcp:101:cat.0 00010000:00010000:3.0:1789043029.996642:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789043029.996662:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083f7dbf9/0x99260d7389c06e97 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676c95 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789043029.996690:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa2a152, atime: 0x6aa2a152, ctime: 0x6aa2a152, blocks: 0xb 00010000:00010000:3.0:1789043029.996710:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=372s v=(0 0) 00010000:00010000:3.0:1789043029.996726:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789043029.996737:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083f7dbf9/0x99260d7389c06e97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c95 expref: 8 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043029.996756:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000083f7dbf9/0x99260d7389c06e97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c95 expref: 8 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043029.996779:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc28a00, rc 0) 00000100:00100000:3.0:1789043029.996847:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:2349:x1875947242489856:12345-192.168.203.17@tcp:101:cat.0 Request processed in 224us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043029.996855:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 70 00000100:00100000:2.0:1789043030.001305:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043030.001404:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242489984 00000100:00100000:0.0:1789043030.001414:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242489984 00002000:00100000:0.0:1789043030.001487:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffffa06a6ff0df80 x1875947242489984/t0(0) o3->3fb32839-ebfd-4c0f-90e4-f036c86704df@192.168.203.17@tcp:326/0 lens 488/0 e 0 to 0 dl 1789043041 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789043030.001498:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa06a6ff0df80 with x1875947242489984 ext(0->4095) 00002000:00010000:0.0:1789043030.001504:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa06a6ff0df80 00000100:00100000:0.0:1789043030.001566:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 7 00000100:00100000:0.0:1789043030.001576:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6ff0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:2350:x1875947242489984:12345-192.168.203.17@tcp:3:cat.0 00000100:00100000:0.0:1789043030.001762:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6ff0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+8:2350:x1875947242489984:12345-192.168.203.17@tcp:3:cat.0 Request processed in 187us (466us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789043030.001770:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 7 00002000:00100000:0.0:1789043030.001777:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffffa06a6ff0df80 x1875947242489984/t0(0) o3->3fb32839-ebfd-4c0f-90e4-f036c86704df@192.168.203.17@tcp:326/0 lens 488/4536 e 0 to 0 dl 1789043041 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789043030.001785:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa06a6ff0df80 with x1875947242489984 ext(0->4095) 00002000:00010000:0.0:1789043030.001788:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa06a6ff0df80 00000100:00080000:2.0:1789043030.002181:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789043030.387671:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043031.410791:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789043031.828983:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:3.0:1789043031.829001:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000004:00080000:1.0:1789043031.852429:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000100:00100000:2.0:1789043031.852630:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a52dfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267639680:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789043031.852697:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:2.0:1789043031.852935:0:12528:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:2.0:1789043031.852952:0:12528:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1789043031.853073:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000020:00080000:0.0:1789043031.853099:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000020:00080000:1.0:1789043031.853158:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa06a79a3a300 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1789043031.853163:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa06a81706a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa06a79a3a000 00000020:00080000:1.0:1789043031.853166:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa06a81706600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa06a6fc1fc00 00000020:00080000:0.0:1789043031.853196:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1789043031.853392:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:3.0:1789043031.853671:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267639680 00000100:00100000:3.0:1789043031.853679:0:8215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267639680 00000100:00100000:3.0:1789043031.853792:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789043031.853811:0:8215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f33aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267639680:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789043031.853988:0:8215:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1789043031.853992:0:8215:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1789043026 -> 1789043026 00002000:00010000:3.0:1789043031.853994:0:8215:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1789043026 -> 1789043026 00002000:00010000:3.0:1789043031.853997:0:8215:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789043026 -> 1789043026 00002000:00010000:3.0:1789043031.853998:0:8215:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1789043031.854061:0:8215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f33aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1875947267639680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 251us (1363us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1789043031.854069:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789043031.854546:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:1.0:1789043031.854552:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:1.0:1789043031.854583:0:3313:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffffa06a52dfd180 x1875947267639680/t4294967324(4294967324) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789043047 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789043031.854595:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa06a52dfd180/2, rc 0, transno 4294967324 00000100:00100000:1.0:1789043031.854600:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a52dfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267639680:0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1789043031.854829:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789043032.306907:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a772b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3314:1875947267639808:0@lo:400:kworker.0 00000100:00100000:0.0:1789043032.306952:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a772b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267640192:0@lo:400:kworker.0 00000100:00100000:3.0:1789043032.307078:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a772b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875947267639936:0@lo:400:kworker.0 00000100:00100000:0.0:1789043032.307285:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043032.307362:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789043032.307369:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a772b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875947267640064:0@lo:400:kworker.0 00000100:00100000:0.0:1789043032.307403:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043032.307711:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267640192 00000100:00100000:0.0:1789043032.307861:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267640192 00000100:00100000:0.0:1789043032.307938:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789043032.307950:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267640192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789043032.308022:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267640192:12345-0@lo:400:kworker.0 Request processed in 74us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043032.308030:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789043032.308060:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267640064 00000100:00100000:0.0:1789043032.308064:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267640064 00000100:00100000:0.0:1789043032.308093:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789043032.308100:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875947267640064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789043032.308134:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875947267640064:12345-0@lo:400:kworker.0 Request processed in 34us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043032.308139:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789043032.308186:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a772b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875947267640064:0@lo:400:kworker.0 00000100:00100000:0.0:1789043032.308200:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a772b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267640192:0@lo:400:kworker.0 00000100:00100000:2.0:1789043032.310645:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043032.310728:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a772b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875947267640320:0@lo:400:kworker.0 00000100:00100000:2.0:1789043032.311247:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043032.311306:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267640320 00000100:00100000:2.0:1789043032.311314:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267640320 00000100:00100000:2.0:1789043032.311374:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789043032.311382:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a453a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875947267640320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789043032.311434:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a453a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875947267640320:12345-0@lo:400:kworker.0 Request processed in 52us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043032.311457:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789043032.311974:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a772b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875947267640320:0@lo:400:kworker.0 00000100:00080000:2.0:1789043032.312035:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789043032.312040:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789043032.313072:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267639808 00000100:00100000:0.0:1789043032.313090:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267639808 00000100:00100000:0.0:1789043032.313192:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1789043032.313203:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3314:x1875947267639808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789043032.313319:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3314:x1875947267639808:12345-0@lo:400:kworker.0 Request processed in 118us (2681us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043032.313329:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1789043032.313378:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a772b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3314:1875947267639808:0@lo:400:kworker.0 00000100:00100000:3.0:1789043032.313726:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043032.313779:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a772b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267640448:0@lo:400:kworker.0 00000100:00100000:3.0:1789043032.313828:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043032.313880:0:8215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267640448 00000100:00100000:2.0:1789043032.313890:0:8215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267640448 00000100:00100000:0.0:1789043032.313956:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267639936 00000100:00100000:2.0:1789043032.313965:0:8215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789043032.313967:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267639936 00000100:00100000:2.0:1789043032.313978:0:8215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a520c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3315:x1875947267640448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789043032.314015:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789043032.314025:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a520c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875947267639936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789043032.314140:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a772b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267640448:0@lo:400:kworker.0 00000100:00100000:0.0:1789043032.325640:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a520c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875947267639936:12345-0@lo:400:kworker.0 Request processed in 11602us (11900us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043032.325660:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789043032.325857:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a772b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875947267639936:0@lo:400:kworker.0 00000100:00100000:2.0:1789043032.327020:0:8215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a520c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3315:x1875947267640448:12345-0@lo:400:kworker.0 Request processed in 13038us (13183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043032.327036:0:8215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00010000:0.0:1789043032.437860:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789043032.820375:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789043032.820405:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a772b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267640576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789043032.820498:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043032.820611:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267640576 00000100:00100000:0.0:1789043032.820622:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267640576 00000100:00100000:0.0:1789043032.820682:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789043032.820692:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875947267640576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789043032.820738:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789043032.820811:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875947267640576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043032.820818:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789043032.820881:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a772b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267640576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789043033.306399:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043033.306566:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043033.306608:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043033.306641:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242490368 00000100:00100000:0.0:1789043033.306648:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043033.306657:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242490368 00000100:00100000:0.0:1789043033.306688:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043033.306719:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242490624 00000100:00100000:0.0:1789043033.306724:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242490624 00000100:00100000:1.0:1789043033.306743:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242490496 00000100:00100000:1.0:1789043033.306757:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242490496 00000100:00100000:0.0:1789043033.306766:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242490240 00000100:00100000:0.0:1789043033.306770:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242490240 00000100:00100000:1.0:1789043033.306815:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 101 00000100:00100000:0.0:1789043033.306824:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 168 00000100:00100000:0.0:1789043033.306837:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2349:x1875947242490624:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1789043033.306939:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2349:x1875947242490624:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 106us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043033.306957:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 168 00000100:00100000:0.0:1789043033.306978:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 169 00000100:00100000:0.0:1789043033.306985:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+18:2349:x1875947242490240:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1789043033.307014:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3fb32839-ebfd-4c0f-90e4-f036c86704df+18:2349:x1875947242490240:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 30us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043033.307020:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 169 00000100:00100000:0.0:1789043033.307038:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 102 00000100:00100000:0.0:1789043033.307045:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2349:x1875947242490496:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1789043033.307073:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2349:x1875947242490496:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 29us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043033.307079:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 102 00000100:00100000:1.0:1789043033.307114:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2349:x1875947242490368:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1789043033.307205:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2349:x1875947242490368:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 380us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043033.307213:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 101 00000100:00080000:1.0:1789043033.307235:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789043033.307249:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789043033.307251:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789043033.311997:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242490112 00000100:00100000:2.0:1789043033.312020:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242490112 00000100:00100000:3.0:1789043033.312417:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 302 00000100:00100000:3.0:1789043033.312431:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2349:x1875947242490112:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1789043033.312572:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2349:x1875947242490112:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 144us (6188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043033.312581:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 302 00010000:00010000:1.0:1789043033.458722:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789043034.354846:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a453a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267640704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789043034.354948:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043034.355154:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267640704 00000100:00100000:2.0:1789043034.355164:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267640704 00000100:00100000:2.0:1789043034.355234:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789043034.355245:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a772b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267640704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789043034.355292:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789043034.355348:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a772b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267640704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043034.355356:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789043034.355833:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a453a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267640704:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789043034.356375:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789043034.482808:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789043035.056592:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043035.056635:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242490752 00000100:00100000:3.0:1789043035.056649:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242490752 00000100:00100000:3.0:1789043035.056728:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 238 00000100:00100000:3.0:1789043035.056740:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a520c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+18:11302:x1875947242490752:12345-192.168.203.17@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789043035.056877:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a520c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+18:11302:x1875947242490752:12345-192.168.203.17@tcp:60:lhsmtool_posix.0 Request processed in 139us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043035.056885:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 238 00000100:00080000:1.0:1789043035.058804:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789043035.059687:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043035.059732:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242491008 00000100:00100000:1.0:1789043035.059744:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242491008 00000100:00100000:1.0:1789043035.059824:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 65 00000100:00100000:1.0:1789043035.059836:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+18:11302:x1875947242491008:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789043035.060261:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+19:11302:x1875947242491008:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 Request processed in 425us (579us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1789043035.060270:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 65 00000100:00100000:3.0:1789043035.246482:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043035.246752:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242491136 00000100:00100000:0.0:1789043035.246766:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242491136 00000100:00100000:0.0:1789043035.246869:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 239 00000100:00100000:0.0:1789043035.246895:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942106d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:12110:x1875947242491136:12345-192.168.203.17@tcp:101:lsof.0 00010000:00010000:0.0:1789043035.246921:0:11703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789043035.247010:0:11703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a7fa6ec00/0x99260d7389c06e9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676c9c expref: -99 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043035.247098:0:11703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a7fa6e200/0x99260d7389c06ea5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043035.247116:0:11703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a7fa6e200/0x99260d7389c06ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043035.247134:0:11703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a7fa6e200/0x99260d7389c06ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789043035.247181:0:11703:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789043035.247186:0:11703:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789043035.247215:0:11703:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a7fa6e200/0x99260d7389c06ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043035.247246:0:11703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a7fa6ec00/0x99260d7389c06e9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c9c expref: 7 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043035.247268:0:11703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a7fa6e200/0x99260d7389c06ea5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c9c expref: 6 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043035.247300:0:11703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a44e19000) 00010000:00010000:0.0:1789043035.247303:0:11703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789043035.247309:0:11703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a7fa6e200, rc 0) 00000100:00100000:0.0:1789043035.247394:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942106d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0293780c-6098-470b-9b22-3d24a3d1ef2d+6:12110:x1875947242491136:12345-192.168.203.17@tcp:101:lsof.0 Request processed in 502us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043035.247402:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 239 00000100:00080000:1.0:1789043035.247807:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789043035.506814:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043036.532201:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789043036.975834:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1789043036.975877:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1789043036.975891:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:1.0:1789043036.975930:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000001:00080000:3.0:1789043036.976715:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000100:00100000:2.0:1789043037.426823:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a772b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3314:1875947267640832:0@lo:400:kworker.0 00000100:00100000:2.0:1789043037.426927:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043037.427885:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a772b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875947267640960:0@lo:400:kworker.0 00000100:00100000:3.0:1789043037.427942:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043037.428050:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267640960 00000100:00100000:3.0:1789043037.428060:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267640960 00000100:00100000:3.0:1789043037.428120:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789043037.428130:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942105500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875947267640960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789043037.428203:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942105500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875947267640960:12345-0@lo:400:kworker.0 Request processed in 73us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043037.428211:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789043037.428264:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a772b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875947267640960:0@lo:400:kworker.0 00000100:00100000:1.0:1789043037.428927:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267640832 00000100:00100000:1.0:1789043037.428935:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267640832 00000100:00100000:1.0:1789043037.428990:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1789043037.428999:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3314:x1875947267640832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789043037.429669:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a772b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267641216:0@lo:400:kworker.0 00000100:00100000:0.0:1789043037.429740:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043037.429784:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789043037.429790:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a772b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875947267641088:0@lo:400:kworker.0 00000100:00100000:0.0:1789043037.429815:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043037.429844:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267641216 00000100:00100000:0.0:1789043037.429848:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267641216 00000100:00100000:0.0:1789043037.429896:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789043037.429905:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267641216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789043037.429950:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267641216:12345-0@lo:400:kworker.0 Request processed in 47us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043037.429958:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789043037.429982:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267641088 00000100:00100000:0.0:1789043037.429986:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267641088 00000100:00100000:0.0:1789043037.430012:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789043037.430019:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875947267641088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789043037.430051:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875947267641088:12345-0@lo:400:kworker.0 Request processed in 33us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043037.430068:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789043037.430111:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a772b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875947267641088:0@lo:400:kworker.0 00000100:00100000:0.0:1789043037.430122:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a772b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267641216:0@lo:400:kworker.0 00000100:00080000:3.0:1789043037.430456:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789043037.430462:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789043037.430871:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a763caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267641472:0@lo:400:kworker.0 00000100:00100000:0.0:1789043037.430917:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043037.430948:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789043037.430955:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a772b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875947267641344:0@lo:400:kworker.0 00000100:00100000:0.0:1789043037.430978:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043037.431020:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267641344 00000100:00100000:0.0:1789043037.431025:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267641344 00000100:00100000:0.0:1789043037.431061:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789043037.431068:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875947267641344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789043037.431105:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875947267641344:12345-0@lo:400:kworker.0 Request processed in 37us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043037.431112:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:0.0:1789043037.431127:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789043037.431147:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a772b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875947267641344:0@lo:400:kworker.0 00000100:00100000:3.0:1789043037.431234:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267641472 00000100:00100000:3.0:1789043037.431238:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267641472 00000100:00100000:3.0:1789043037.431280:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789043037.431288:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267641472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789043037.431332:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267641472:12345-0@lo:400:kworker.0 Request processed in 46us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043037.431339:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789043037.431363:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1789043037.431369:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa06a52dfd180, transno 4294967324 00000100:00100000:3.0:1789043037.431382:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a763caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267641472:0@lo:400:kworker.0 00000100:00080000:0.0:1789043037.432271:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789043037.433788:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3314:x1875947267640832:12345-0@lo:400:kworker.0 Request processed in 4779us (6850us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043037.433805:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1789043037.438902:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a772b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3314:1875947267640832:0@lo:400:kworker.0 00010000:00010000:0.0:1789043037.554910:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789043037.939152:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789043037.939185:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267641600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789043037.939329:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043037.939567:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267641600 00000100:00100000:2.0:1789043037.939579:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267641600 00000100:00100000:2.0:1789043037.939644:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789043037.939656:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6edbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267641600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789043037.939701:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789043037.939768:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6edbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267641600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043037.939776:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789043037.939945:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267641600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789043038.424907:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043038.424963:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043038.425014:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043038.425049:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043038.425086:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242491392 00000100:00100000:0.0:1789043038.425100:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242491392 00000100:00100000:3.0:1789043038.425102:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043038.425185:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242491264 00000100:00100000:2.0:1789043038.425191:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242491264 00000100:00100000:2.0:1789043038.425254:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 304 00000100:00100000:2.0:1789043038.425266:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2351:x1875947242491264:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1789043038.425356:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2351:x1875947242491264:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 91us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043038.425365:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 304 00000100:00080000:2.0:1789043038.425590:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789043038.425605:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242491776 00000100:00100000:2.0:1789043038.425609:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242491776 00000100:00100000:2.0:1789043038.425646:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 173 00000100:00100000:2.0:1789043038.425654:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0293780c-6098-470b-9b22-3d24a3d1ef2d+6:2351:x1875947242491776:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1789043038.425694:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0293780c-6098-470b-9b22-3d24a3d1ef2d+6:2351:x1875947242491776:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 40us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043038.425701:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 173 00000100:00100000:0.0:1789043038.425887:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 174 00000100:00100000:0.0:1789043038.425896:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942105180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+18:2351:x1875947242491392:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1789043038.425931:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942105180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+18:2351:x1875947242491392:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 37us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043038.425956:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 174 00000100:00080000:2.0:1789043038.427122:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789043038.430367:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242491648 00000100:00100000:1.0:1789043038.430388:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242491648 00000100:00100000:3.0:1789043038.432734:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242491520 00000100:00100000:3.0:1789043038.432764:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242491520 00000100:00100000:3.0:1789043038.433771:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 105 00000100:00100000:3.0:1789043038.433789:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942104000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2351:x1875947242491520:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1789043038.433897:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942104000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2351:x1875947242491520:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 114us (8846us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043038.433907:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 105 00000100:00080000:0.0:1789043038.434426:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789043038.437545:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 106 00000100:00100000:2.0:1789043038.437563:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06942105c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2351:x1875947242491648:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1789043038.437696:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06942105c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2351:x1875947242491648:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 137us (12731us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043038.437704:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 106 00000100:00080000:1.0:1789043038.437901:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789043038.579725:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789043039.040732:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789043039.040763:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789043039.041852:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1789043039.041865:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:02000400:1.0:1789043039.071963:0:12876:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 08:23:57 (1789043037) 00000100:00100000:1.0:1789043039.474969:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a453a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267641728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789043039.475077:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043039.475251:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267641728 00000100:00100000:0.0:1789043039.475264:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267641728 00000100:00100000:0.0:1789043039.475343:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789043039.475354:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6edb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267641728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789043039.475400:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789043039.475462:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6edb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267641728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043039.475470:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1789043039.475656:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789043039.475703:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a453a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267641728:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789043039.603647:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043040.627611:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043041.652655:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789043042.548018:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875947267642112:0@lo:400:kworker.0 00000100:00100000:0.0:1789043042.548123:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043042.548217:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789043042.548224:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267642240:0@lo:400:kworker.0 00000100:00100000:0.0:1789043042.548594:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043042.548636:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267642112 00000100:00100000:0.0:1789043042.548646:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267642112 00000100:00100000:0.0:1789043042.548719:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789043042.548744:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875947267642112:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789043042.549045:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789043042.549122:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875947267641984:0@lo:400:kworker.0 00000100:00100000:3.0:1789043042.549163:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043042.549192:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267642496:0@lo:400:kworker.0 00000100:00100000:2.0:1789043042.549403:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3314:1875947267641856:0@lo:400:kworker.0 00000100:00100000:3.0:1789043042.549719:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043042.549794:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267642240 00000100:00100000:2.0:1789043042.549954:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043042.549989:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875947267642368:0@lo:400:kworker.0 00000100:00100000:2.0:1789043042.550014:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043042.550050:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267641984 00000100:00100000:2.0:1789043042.550057:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267641984 00000100:00100000:2.0:1789043042.550099:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267642368 00000100:00100000:2.0:1789043042.550102:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267642368 00000100:00100000:2.0:1789043042.550125:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789043042.550134:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52dfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875947267641984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789043042.550190:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52dfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875947267641984:12345-0@lo:400:kworker.0 Request processed in 56us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043042.550213:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789043042.550232:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789043042.550239:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a453a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875947267642368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789043042.550282:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a453a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875947267642368:12345-0@lo:400:kworker.0 Request processed in 44us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043042.550289:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789043042.550336:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875947267642368:0@lo:400:kworker.0 00000100:00100000:2.0:1789043042.550375:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267642496 00000100:00100000:2.0:1789043042.550379:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267642496 00000100:00100000:3.0:1789043042.550451:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267642240 00000100:00100000:1.0:1789043042.552993:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267641856 00000100:00100000:1.0:1789043042.553014:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267641856 00000100:00100000:1.0:1789043042.553108:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1789043042.553122:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3314:x1875947267641856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789043042.553542:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875947267642112:12345-0@lo:400:kworker.0 Request processed in 4798us (5415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043042.553569:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789043042.553645:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875947267642112:0@lo:400:kworker.0 00000100:00080000:0.0:1789043042.553714:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789043042.553735:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789043042.553739:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789043042.554004:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3314:x1875947267641856:12345-0@lo:400:kworker.0 Request processed in 885us (4048us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043042.554013:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1789043042.554061:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3314:1875947267641856:0@lo:400:kworker.0 00000100:00100000:0.0:1789043042.554126:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875947267641984:0@lo:400:kworker.0 00000100:00100000:2.0:1789043042.554450:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789043042.554466:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267642496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789043042.554555:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267642496:12345-0@lo:400:kworker.0 Request processed in 95us (4835us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043042.554561:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789043042.554574:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789043042.554580:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267642240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789043042.554620:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267642240:12345-0@lo:400:kworker.0 Request processed in 40us (6027us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043042.554626:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789043042.554657:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267642240:0@lo:400:kworker.0 00000100:00100000:1.0:1789043042.559117:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267642496:0@lo:400:kworker.0 00010000:00010000:1.0:1789043042.675097:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789043043.059584:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267642624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789043043.059659:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043043.059774:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267642624 00000100:00100000:1.0:1789043043.059792:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267642624 00000100:00100000:3.0:1789043043.059995:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789043043.060012:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267642624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789043043.060064:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789043043.063695:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267642624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3674us (4021us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043043.063714:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789043043.066764:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267642624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789043043.430820:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043043.431098:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242492032 00000100:00100000:1.0:1789043043.431112:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242492032 00000100:00100000:1.0:1789043043.431201:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 66 00000100:00100000:1.0:1789043043.431220:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+18:12331:x1875947242492032:12345-192.168.203.17@tcp:35:umount.0 00000100:00080000:0.0:1789043043.431804:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789043043.432120:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+19:12331:x1875947242492032:12345-192.168.203.17@tcp:35:umount.0 Request processed in 903us (1309us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1789043043.432131:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 66 00000100:00100000:0.0:1789043043.450189:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043043.450578:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242492288 00000100:00100000:2.0:1789043043.450592:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242492288 00000100:00100000:2.0:1789043043.450659:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 67 00000100:00100000:2.0:1789043043.450671:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+19:12331:x1875947242492288:12345-192.168.203.17@tcp:35:umount.0 00000100:00100000:2.0:1789043043.451164:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+20:12331:x1875947242492288:12345-192.168.203.17@tcp:35:umount.0 Request processed in 492us (999us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1789043043.451174:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 67 00000100:00100000:3.0:1789043043.455082:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043043.455419:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242492544 00000100:00100000:2.0:1789043043.455434:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242492544 00000100:00100000:2.0:1789043043.455553:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 68 00000100:00100000:2.0:1789043043.455568:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5ffdf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+20:12331:x1875947242492544:12345-192.168.203.17@tcp:35:umount.0 00000100:00100000:3.0:1789043043.460213:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5ffdf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+21:12331:x1875947242492544:12345-192.168.203.17@tcp:35:umount.0 Request processed in 4612us (5110us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1789043043.460232:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 68 00000100:00100000:3.0:1789043043.463047:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043043.463151:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242492800 00000100:00100000:1.0:1789043043.463164:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242492800 00000100:00100000:1.0:1789043043.463264:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 69 00000100:00100000:1.0:1789043043.463278:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+21:12331:x1875947242492800:12345-192.168.203.17@tcp:35:umount.0 00000100:00100000:1.0:1789043043.463809:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+22:12331:x1875947242492800:12345-192.168.203.17@tcp:35:umount.0 Request processed in 532us (778us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1789043043.463819:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 69 00000100:00100000:0.0:1789043043.469324:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043043.469376:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043043.469668:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242492928 00000100:00100000:3.0:1789043043.469682:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242492928 00000100:00100000:3.0:1789043043.469781:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242493056 00000100:00100000:3.0:1789043043.469803:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242493056 00000100:00100000:3.0:1789043043.469845:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 18 00000100:00100000:3.0:1789043043.469857:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+14:2350:x1875947242492928:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789043043.469885:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789043043.469911:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a6fc28c00/0x99260d7389c05ebb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676827 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043043.469934:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789043043.470006:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+13:2350:x1875947242492928:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 151us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043043.470014:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 18 00000100:00100000:3.0:1789043043.470034:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 19 00000100:00100000:3.0:1789043043.470040:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+12:2350:x1875947242493056:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789043043.470048:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789043043.470059:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c06107 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768f2 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043043.470069:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789043043.470087:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+11:2350:x1875947242493056:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 47us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043043.470094:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 19 00000100:00100000:2.0:1789043043.476351:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043043.483043:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242493440 00000100:00100000:3.0:1789043043.483066:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242493440 00000100:00100000:3.0:1789043043.483252:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 20 00000100:00100000:3.0:1789043043.483266:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+11:2349:x1875947242493440:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789043043.483287:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789043043.483312:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a6fc28600/0x99260d7389c05e83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6767ef expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043043.483351:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789043043.483438:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+10:2349:x1875947242493440:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 175us (7101us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043043.483447:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 20 00000100:00100000:2.0:1789043043.483776:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043043.485247:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242493568 00000100:00100000:3.0:1789043043.485265:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242493568 00000100:00100000:3.0:1789043043.485347:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 72 00000100:00100000:3.0:1789043043.485357:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+7:2348:x1875947242493568:12345-192.168.203.17@tcp:9:umount.0 00000020:00000080:3.0:1789043043.485398:0:6690:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x99260d7389c0645d 00000020:00010000:3.0:1789043043.485407:0:6690:0:(genops.c:1929:obd_stale_export_put()) Put export ffffa06a7f847800: total 0 00000100:00080000:3.0:1789043043.485413:0:6690:0:(import.c:65:import_set_state_nolock()) ffffa06a7f844000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789043043.485463:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1789043043.485839:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2348:x1875947242493568:12345-192.168.203.17@tcp:9:umount.0 Request processed in 480us (2062us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043043.485847:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 72 00000020:00010000:2.0:1789043043.485976:0:11175:0:(genops.c:1915:obd_stale_export_get()) Get export ffffa06a7f847800: total 0 00010000:00010000:2.0:1789043043.486013:0:11175:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa06a7f847800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1789043043.486080:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083f7dbf9/0x99260d7389c06e97 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c95 expref: 4 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043043.486119:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005527b901/0x99260d7389c067f9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ac7 expref: 3 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043043.486134:0:11175:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa06a7f847800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1789043043.486144:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043043.486146:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043043.486148:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789043043.487163:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789043043.491779:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043043.492066:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242493696 00000100:00100000:3.0:1789043043.492081:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242493696 00000100:00100000:3.0:1789043043.492198:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 73 00000100:00100000:3.0:1789043043.492212:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+5:2348:x1875947242493696:12345-192.168.203.17@tcp:9:umount.0 00000020:00000080:3.0:1789043043.492252:0:6691:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x99260d7389c061f5 00000100:00080000:3.0:1789043043.492264:0:6691:0:(import.c:65:import_set_state_nolock()) ffffa06a764ee000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789043043.492318:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1789043043.492684:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3fb32839-ebfd-4c0f-90e4-f036c86704df+2:2348:x1875947242493696:12345-192.168.203.17@tcp:9:umount.0 Request processed in 473us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043043.492694:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 73 00010000:00010000:2.0:1789043043.492889:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789043043.493313:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789043043.516093:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043043.516746:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242494720 00000100:00100000:2.0:1789043043.516760:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242494720 00000100:00100000:2.0:1789043043.516830:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 240 00000100:00100000:2.0:1789043043.516842:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+22:2348:x1875947242494720:12345-192.168.203.17@tcp:39:umount.0 00000020:00000080:2.0:1789043043.516897:0:5845:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x99260d7389c05e91 00000020:00010000:2.0:1789043043.516926:0:5845:0:(genops.c:1929:obd_stale_export_put()) Put export ffffa06a76568000: total 0 00000100:00080000:2.0:1789043043.516932:0:5845:0:(import.c:65:import_set_state_nolock()) ffffa06a7656f000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789043043.516969:0:5845:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:2.0:1789043043.517448:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3fb32839-ebfd-4c0f-90e4-f036c86704df+21:2348:x1875947242494720:12345-192.168.203.17@tcp:39:umount.0 Request processed in 603us (1364us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1789043043.517457:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 240 00000020:00010000:1.0:1789043043.518230:0:5834:0:(genops.c:1915:obd_stale_export_get()) Get export ffffa06a76568000: total 0 00010000:00010000:1.0:1789043043.518293:0:5834:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa06a76568000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1789043043.518340:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:1.0:1789043043.518344:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789043043.518357:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979400/0x99260d7389c06d78 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c48 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043043.518381:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa06a44e19c00) 00010000:00010000:1.0:1789043043.518384:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789043043.518389:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979000/0x99260d7389c064b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6769ee expref: 19 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043043.518402:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa06a457d3100) 00010000:00010000:1.0:1789043043.518405:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789043043.518410:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979c00/0x99260d7389c06877 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676aea expref: 18 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043043.518443:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa06a457d3600) 00010000:00010000:1.0:1789043043.518446:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789043043.518450:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50978400/0x99260d7389c066da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676a7a expref: 17 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043043.518463:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa06a44e19c00) 00010000:00010000:1.0:1789043043.518466:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789043043.518469:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c061cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67691c expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043043.518498:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:1.0:1789043043.518501:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789043043.518505:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687400/0x99260d7389c06e58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c80 expref: 15 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043043.518577:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a44e19000) 00010000:00010000:1.0:1789043043.518580:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789043043.518584:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687600/0x99260d7389c0685b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ae3 expref: 14 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043043.518598:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa06a44e19600) 00010000:00010000:1.0:1789043043.518600:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043043.518604:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687c00/0x99260d7389c06177 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676907 expref: 13 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043043.518618:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa06a457d3600) 00010000:00010000:1.0:1789043043.518621:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789043043.518632:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40031c00/0x99260d7389c067ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ab2 expref: 12 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043043.518649:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa06a55221400) 00010000:00010000:1.0:1789043043.518651:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789043043.518655:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a40030400/0x99260d7389c0615b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676900 expref: 11 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043043.518674:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa06a457d3600) 00010000:00010000:1.0:1789043043.518676:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789043043.518680:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a50979e00/0x99260d7389c067e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ac0 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043043.518696:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa06a457d3100) 00010000:00010000:1.0:1789043043.518699:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789043043.518703:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28400/0x99260d7389c06b56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676bbc expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043043.518730:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa06a44e19f00) 00010000:00010000:1.0:1789043043.518733:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789043043.518737:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c06e82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c8e expref: 8 pid: 6714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043043.518752:0:5834:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa06a76568000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1789043043.518769:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043043.518771:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043043.518773:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789043043.533724:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043043.533843:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242494848 00000100:00100000:1.0:1789043043.533857:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242494848 00000100:00100000:1.0:1789043043.533985:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 178 00000100:00100000:1.0:1789043043.534004:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0293780c-6098-470b-9b22-3d24a3d1ef2d+6:2349:x1875947242494848:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1789043043.534105:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0293780c-6098-470b-9b22-3d24a3d1ef2d+6:2349:x1875947242494848:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 111us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043043.534114:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 178 00000100:00080000:0.0:1789043043.534810:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789043043.703789:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789043044.595066:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267642752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789043044.595165:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043044.603258:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267642752 00000100:00100000:2.0:1789043044.603281:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267642752 00000100:00100000:2.0:1789043044.603481:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789043044.603494:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6edbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267642752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789043044.603583:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789043044.603702:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6edbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267642752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 210us (8536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043044.603725:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1789043044.604042:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789043044.604694:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267642752:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789043044.723549:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789043045.541924:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043045.541986:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043045.542066:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242494976 00000100:00100000:1.0:1789043045.542082:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242494976 00000100:00100000:2.0:1789043045.542089:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242495104 00000100:00100000:2.0:1789043045.542096:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242495104 00000100:00100000:1.0:1789043045.542174:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 21 00000100:00100000:1.0:1789043045.542191:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42f42d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+11:2351:x1875947242494976:12345-192.168.203.17@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789043045.542197:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 22 00000100:00100000:2.0:1789043045.542210:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+11:2351:x1875947242495104:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789043045.542214:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789043045.542222:0:6705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789043045.542246:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a58605000/0x99260d7389c05f6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676866 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043045.542246:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a40031400/0x99260d7389c05f63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67683c expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043045.542283:0:6705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789043045.542283:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789043045.542379:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42f42d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+9:2351:x1875947242494976:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 193us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043045.542387:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 21 00000100:00100000:2.0:1789043045.542498:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+8:2351:x1875947242495104:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 291us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043045.542505:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 22 00000100:00100000:3.0:1789043045.542734:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043045.543544:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242495232 00000100:00100000:0.0:1789043045.543554:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242495232 00000100:00100000:0.0:1789043045.543617:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 23 00000100:00100000:0.0:1789043045.543627:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42f43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+8:2350:x1875947242495232:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789043045.543642:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789043045.543659:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a413a0c00/0x99260d7389c06100 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca6768eb expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043045.543673:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789043045.543721:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42f43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+7:2350:x1875947242495232:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 95us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043045.543728:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 23 00000100:00100000:3.0:1789043045.558725:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043045.558858:0:11703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242495488 00000100:00100000:0.0:1789043045.558873:0:11703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242495488 00000100:00100000:0.0:1789043045.558990:0:11703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 241 00000100:00100000:0.0:1789043045.559002:0:11703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42f42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0293780c-6098-470b-9b22-3d24a3d1ef2d+6:2348:x1875947242495488:12345-192.168.203.17@tcp:39:umount.0 00000020:00000080:0.0:1789043045.559069:0:11703:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x99260d7389c05f78 00000020:00010000:0.0:1789043045.559080:0:11703:0:(genops.c:1929:obd_stale_export_put()) Put export ffffa06942b64800: total 0 00000100:00080000:0.0:1789043045.559086:0:11703:0:(import.c:65:import_set_state_nolock()) ffffa06942b63800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789043045.559125:0:11703:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00080000:1.0:1789043045.559552:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789043045.559720:0:11703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42f42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0293780c-6098-470b-9b22-3d24a3d1ef2d+5:2348:x1875947242495488:12345-192.168.203.17@tcp:39:umount.0 Request processed in 717us (1399us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1789043045.559730:0:11703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 241 00000020:00010000:3.0:1789043045.560163:0:5834:0:(genops.c:1915:obd_stale_export_get()) Get export ffffa06942b64800: total 0 00010000:00010000:3.0:1789043045.560169:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043045.560223:0:5834:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa06942b64800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789043045.560268:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a44e19000) 00010000:00010000:3.0:1789043045.560272:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789043045.560284:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a7fa6e200/0x99260d7389c06ea5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676c9c expref: 4 pid: 11703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043045.560309:0:5834:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa06942b64800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1789043045.560320:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043045.560322:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043045.560324:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789043045.599278:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043045.599465:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242495744 00000100:00100000:3.0:1789043045.599481:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242495744 00000100:00100000:3.0:1789043045.599574:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 306 00000100:00100000:3.0:1789043045.599586:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+7:2348:x1875947242495744:12345-192.168.203.17@tcp:251:umount.0 00000020:00000080:3.0:1789043045.599647:0:5841:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x99260d7389c05e6e 00000020:00010000:3.0:1789043045.599740:0:5841:0:(genops.c:1929:obd_stale_export_put()) Put export ffffa069412eb800: total 0 00000100:00080000:3.0:1789043045.599746:0:5841:0:(import.c:65:import_set_state_nolock()) ffffa069412e8800 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1789043045.599897:0:11175:0:(genops.c:1915:obd_stale_export_get()) Get export ffffa069412eb800: total 0 00010000:00010000:2.0:1789043045.599948:0:11175:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa069412eb800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789043045.599996:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a6fc29400/0x99260d7389c05ec2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca67682e expref: 3 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043045.600044:0:11175:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa069412eb800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1789043045.600057:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043045.600059:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043045.600061:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789043045.600197:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e30fd60e-ee3c-46d4-a0cf-f36638a67c48+1:2348:x1875947242495744:12345-192.168.203.17@tcp:251:umount.0 Request processed in 612us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043045.600206:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 306 00000020:00000080:3.0:1789043045.600220:0:5841:0:(genops.c:893:class_export_put()) final put ffffa069412eb800/e30fd60e-ee3c-46d4-a0cf-f36638a67c48 00000020:00000080:1.0:1789043045.600371:0:8:0:(genops.c:852:class_export_destroy()) destroying export ffffa069412eb800/e30fd60e-ee3c-46d4-a0cf-f36638a67c48 for MGS 00000020:00000080:1.0:1789043045.601196:0:8:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffffa069412e8800 for MGS 00010000:00010000:0.0:1789043045.746718:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043046.772471:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789043047.232607:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3fb32839-ebfd-4c0f-90e4-f036c86704df 00000020:00000080:1.0:1789043047.232619:0:6716:0:(genops.c:893:class_export_put()) final put ffffa06a764ed000/3fb32839-ebfd-4c0f-90e4-f036c86704df 00000020:00000080:0.0:1789043047.232919:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a764ed000/3fb32839-ebfd-4c0f-90e4-f036c86704df for lustre-OST0000 00000020:00000080:0.0:1789043047.232993:0:36:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffffa06a764ee000 for lustre-OST0000 00000001:00100000:0.0:1789043047.240843:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0293780c-6098-470b-9b22-3d24a3d1ef2d 00000001:00080000:0.0:1789043047.240868:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1789043047.240876:0:5867:0:(genops.c:893:class_export_put()) final put ffffa06942b64800/0293780c-6098-470b-9b22-3d24a3d1ef2d 00000001:00080000:0.0:1789043047.240898:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:0.0:1789043047.240909:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3fb32839-ebfd-4c0f-90e4-f036c86704df 00000001:00080000:0.0:1789043047.240914:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:0.0:1789043047.240922:0:5867:0:(genops.c:893:class_export_put()) final put ffffa06a76568000/3fb32839-ebfd-4c0f-90e4-f036c86704df 00000020:00000080:0.0:1789043047.240938:0:8:0:(genops.c:852:class_export_destroy()) destroying export ffffa06942b64800/0293780c-6098-470b-9b22-3d24a3d1ef2d for lustre-MDT0000 00000020:00000080:0.0:1789043047.240990:0:8:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a76568000/3fb32839-ebfd-4c0f-90e4-f036c86704df for lustre-MDT0000 00000020:00000080:0.0:1789043047.241026:0:8:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffffa06942b63800 for lustre-MDT0000 00000020:00000080:0.0:1789043047.241034:0:8:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffffa06a7656f000 for lustre-MDT0000 00000001:00100000:3.0:1789043047.246668:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3fb32839-ebfd-4c0f-90e4-f036c86704df 00000020:00000080:3.0:1789043047.246679:0:7647:0:(genops.c:893:class_export_put()) final put ffffa06a7f847800/3fb32839-ebfd-4c0f-90e4-f036c86704df 00000020:00000080:0.0:1789043047.246768:0:8:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a7f847800/3fb32839-ebfd-4c0f-90e4-f036c86704df for lustre-OST0001 00000020:00000080:0.0:1789043047.246828:0:8:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffffa06a7f844000 for lustre-OST0001 00000100:00100000:0.0:1789043047.667879:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875947267643136:0@lo:400:kworker.0 00000100:00100000:0.0:1789043047.667992:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043047.668069:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789043047.668076:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267643264:0@lo:400:kworker.0 00000100:00100000:0.0:1789043047.668119:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043047.668165:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267643136 00000100:00100000:0.0:1789043047.668175:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267643136 00000100:00100000:0.0:1789043047.668239:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789043047.668250:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875947267643136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789043047.668313:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875947267643136:12345-0@lo:400:kworker.0 Request processed in 65us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043047.668320:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789043047.668384:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875947267643136:0@lo:400:kworker.0 00000100:00100000:3.0:1789043047.668459:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875947267643008:0@lo:400:kworker.0 00000100:00100000:3.0:1789043047.668494:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043047.668550:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267643520:0@lo:400:kworker.0 00000100:00100000:3.0:1789043047.668575:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043047.668597:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789043047.668604:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3315:1875947267642880:0@lo:400:kworker.0 00000100:00100000:3.0:1789043047.668633:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043047.668659:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875947267643392:0@lo:400:kworker.0 00000100:00100000:3.0:1789043047.668698:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043047.668749:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267643264 00000100:00100000:3.0:1789043047.668753:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267643264 00000100:00100000:3.0:1789043047.668789:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267643520 00000100:00100000:3.0:1789043047.668793:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267643520 00000100:00100000:3.0:1789043047.668818:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789043047.668826:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267643264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789043047.668869:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267643264:12345-0@lo:400:kworker.0 Request processed in 43us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043047.668876:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789043047.668891:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789043047.668897:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267643520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789043047.668935:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267643520:12345-0@lo:400:kworker.0 Request processed in 37us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043047.668941:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789043047.668985:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267642880 00000100:00100000:3.0:1789043047.668989:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267642880 00000100:00100000:3.0:1789043047.669015:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1789043047.669023:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a42ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3315:x1875947267642880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789043047.669056:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a42ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3315:x1875947267642880:12345-0@lo:400:kworker.0 Request processed in 34us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043047.669062:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1789043047.669093:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267643008 00000100:00100000:3.0:1789043047.669097:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267643008 00000100:00100000:3.0:1789043047.669123:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267643392 00000100:00100000:3.0:1789043047.669127:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267643392 00000100:00100000:3.0:1789043047.669150:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789043047.669156:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a77122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875947267643008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789043047.669190:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a77122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875947267643008:12345-0@lo:400:kworker.0 Request processed in 34us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043047.669196:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789043047.669208:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789043047.669214:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875947267643392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789043047.669243:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875947267643392:12345-0@lo:400:kworker.0 Request processed in 29us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043047.669249:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789043047.669290:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3315:1875947267642880:0@lo:400:kworker.0 00000100:00100000:3.0:1789043047.669301:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875947267643392:0@lo:400:kworker.0 00000100:00100000:3.0:1789043047.669310:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875947267643008:0@lo:400:kworker.0 00000100:00100000:3.0:1789043047.669318:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267643520:0@lo:400:kworker.0 00000100:00100000:3.0:1789043047.669368:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267643264:0@lo:400:kworker.0 00000100:00080000:1.0:1789043047.669631:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789043047.669642:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789043047.669645:0:5842:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000004:1.0:1789043047.716419:0:13079:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1789043047.730623:0:13079:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1789043047.730698:0:13079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a58604800/0x99260d7389c05f01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05f08 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043047.730716:0:13079:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a58604800/0x99260d7389c05f01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05f08 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043047.730723:0:13079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a58604800/0x99260d7389c05f01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x99260d7389c05f08 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043047.730737:0:13079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffffa06a58604800/0x99260d7389c05f01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x99260d7389c05f08 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043047.730759:0:13079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789043047.730765:0:13079:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789043047.730794:0:13079:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789043047.730799:0:13079:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789043047.730806:0:13079:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789043047.730839:0:13079:0:(import.c:65:import_set_state_nolock()) ffffa06a77330800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1789043047.730970:0:11175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789043047.730978:0:11175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a58604800/0x99260d7389c05f01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x99260d7389c05f08 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043047.730986:0:11175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a58604800 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:2.0:1789043047.730990:0:11175:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a58604800/0x99260d7389c05f01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x99260d7389c05f08 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043047.730999:0:11175:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a58604800/0x99260d7389c05f01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x99260d7389c05f08 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789043047.731007:0:11175:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a58604800/0x99260d7389c05f01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x99260d7389c05f08 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789043047.731012:0:11175:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789043047.731015:0:11175:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789043047.731018:0:11175:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789043047.731050:0:11175:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a58604800/0x99260d7389c05f01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x99260d7389c05f08 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043047.731056:0:11175:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789043047.731089:0:11175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a58604800/0x99260d7389c05f01 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x99260d7389c05f08 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043047.731097:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a58604800/0x99260d7389c05f01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x99260d7389c05f08 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043047.731125:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043047.731126:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043047.731128:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789043047.731137:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789043047.731159:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267643776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789043047.731243:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043047.731312:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267643776 00000100:00100000:2.0:1789043047.731320:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267643776 00000100:00100000:2.0:1789043047.731378:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789043047.731389:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267643776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789043047.731404:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789043047.731422:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a6fc29600/0x99260d7389c05f08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x99260d7389c05f01 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043047.731436:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789043047.731474:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:3313:x1875947267643776:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043047.731482:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789043047.731563:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267643776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789043047.731649:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875947267643648:0@lo:39:umount.0 00000100:00100000:0.0:1789043047.731697:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043047.731817:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267643648 00000100:00100000:2.0:1789043047.731822:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267643648 00000100:00100000:2.0:1789043047.731855:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789043047.731862:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875947267643648:12345-0@lo:39:umount.0 00000020:00000080:2.0:1789043047.731891:0:5845:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x99260d7389c05c7d 00000100:00080000:2.0:1789043047.731902:0:5845:0:(import.c:65:import_set_state_nolock()) ffffa06a79a13000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789043047.731954:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3311:x1875947267643648:12345-0@lo:39:umount.0 Request processed in 93us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043047.731971:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1789043047.731979:0:5845:0:(genops.c:893:class_export_put()) final put ffffa06a79a17800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1789043047.732004:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789043047.732014:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a79a17800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1789043047.732083:0:36:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffffa06a79a13000 for lustre-MDT0000 00000100:00080000:0.0:1789043047.732140:0:3311:0:(import.c:65:import_set_state_nolock()) ffffa06a77330800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789043047.732160:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875947267643648:0@lo:39:umount.0 00000100:00080000:2.0:1789043047.732286:0:13079:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789043047.732291:0:13079:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789043047.732296:0:13079:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789043047.733312:0:13079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41686000/0x99260d7389c05f0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05f16 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043047.733327:0:13079:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41686000/0x99260d7389c05f0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05f16 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043047.733335:0:13079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41686000/0x99260d7389c05f0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x99260d7389c05f16 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043047.733342:0:13079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffffa06a41686000/0x99260d7389c05f0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x99260d7389c05f16 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043047.733373:0:13079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789043047.733380:0:13079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a58605a00/0x99260d7389c05e28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05e2f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043047.733387:0:13079:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a58605a00/0x99260d7389c05e28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05e2f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043047.733393:0:13079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a58605a00/0x99260d7389c05e28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x99260d7389c05e2f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043047.733412:0:13079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffffa06a58605a00/0x99260d7389c05e28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x99260d7389c05e2f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043047.733423:0:13079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789043047.733431:0:13079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a50978200/0x99260d7389c0612a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06131 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043047.733437:0:13079:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a50978200/0x99260d7389c0612a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c06131 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043047.733443:0:13079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a50978200/0x99260d7389c0612a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x99260d7389c06131 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043047.733449:0:13079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffffa06a50978200/0x99260d7389c0612a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x99260d7389c06131 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043047.733466:0:13079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789043047.733477:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789043047.733484:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a41686000/0x99260d7389c05f0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x99260d7389c05f16 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043047.733491:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686000 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:2.0:1789043047.733495:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a41686000/0x99260d7389c05f0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x99260d7389c05f16 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043047.733504:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a41686000/0x99260d7389c05f0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x99260d7389c05f16 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789043047.733548:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a41686000/0x99260d7389c05f0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x99260d7389c05f16 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789043047.733563:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789043047.733566:0:5835:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1789043047.733601:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a41686000/0x99260d7389c05f0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x99260d7389c05f16 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043047.733607:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789043047.733628:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a41686000/0x99260d7389c05f0f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x99260d7389c05f16 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043047.733636:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a41686000/0x99260d7389c05f0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x99260d7389c05f16 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043047.733649:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789043047.733652:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a58605a00/0x99260d7389c05e28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x99260d7389c05e2f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043047.733657:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a58605a00 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:2.0:1789043047.733660:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a58605a00/0x99260d7389c05e28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x99260d7389c05e2f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043047.733666:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a58605a00/0x99260d7389c05e28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x99260d7389c05e2f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789043047.733672:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a58605a00/0x99260d7389c05e28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x99260d7389c05e2f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789043047.733677:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789043047.733679:0:5835:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789043047.733682:0:5835:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789043047.733716:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a58605a00/0x99260d7389c05e28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x99260d7389c05e2f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043047.733722:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789043047.733843:0:11175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789043047.733849:0:11175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a50978200/0x99260d7389c0612a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x99260d7389c06131 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043047.733856:0:11175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50978200 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:0.0:1789043047.733859:0:11175:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a50978200/0x99260d7389c0612a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x99260d7389c06131 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043047.733867:0:11175:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a50978200/0x99260d7389c0612a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x99260d7389c06131 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789043047.733881:0:11175:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a50978200/0x99260d7389c0612a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x99260d7389c06131 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789043047.733887:0:11175:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789043047.733889:0:11175:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789043047.733891:0:11175:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789043047.733907:0:11175:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a50978200/0x99260d7389c0612a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x99260d7389c06131 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043047.733913:0:11175:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789043047.733947:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a58605a00/0x99260d7389c05e28 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x99260d7389c05e2f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043047.733955:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a58605a00/0x99260d7389c05e28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x99260d7389c05e2f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043047.733966:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3315:1875947267644160:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789043047.733972:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043047.733975:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043047.733977:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789043047.733992:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267643904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789043047.734042:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043047.734074:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789043047.734160:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789043047.734173:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6fc26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3314:1875947267644032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789043047.734206:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043047.734242:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267643904 00000100:00100000:1.0:1789043047.734250:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267643904 00010000:00010000:0.0:1789043047.734548:0:11175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a50978200/0x99260d7389c0612a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x99260d7389c06131 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043047.734556:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a50978200/0x99260d7389c0612a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x99260d7389c06131 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043047.734567:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043047.734569:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043047.734570:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789043047.734583:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267644160 00000100:00100000:0.0:1789043047.734587:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267644160 00010000:00010000:2.0:1789043047.734876:0:13079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a40030000/0x99260d7389c05bdc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05be3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043047.734887:0:13079:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a40030000/0x99260d7389c05bdc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05be3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043047.734895:0:13079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a40030000/0x99260d7389c05bdc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x99260d7389c05be3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043047.734902:0:13079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffffa06a40030000/0x99260d7389c05bdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x99260d7389c05be3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043047.734906:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267644032 00000100:00100000:1.0:1789043047.734911:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267644032 00010000:00010000:2.0:1789043047.735040:0:13079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789043047.735048:0:13079:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1789043047.735053:0:13079:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1789043047.735083:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789043047.735100:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a40030000/0x99260d7389c05bdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x99260d7389c05be3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043047.735110:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a40030000 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:2.0:1789043047.735114:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a40030000/0x99260d7389c05bdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x99260d7389c05be3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043047.735123:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a40030000/0x99260d7389c05bdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x99260d7389c05be3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789043047.735131:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a40030000/0x99260d7389c05bdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x99260d7389c05be3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789043047.735136:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789043047.735139:0:5835:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789043047.735141:0:5835:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1789043047.735164:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a40030000/0x99260d7389c05bdc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x99260d7389c05be3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043047.735171:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789043047.735185:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a40030000/0x99260d7389c05bdc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x99260d7389c05be3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043047.735193:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a40030000/0x99260d7389c05bdc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x99260d7389c05be3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043047.735208:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043047.735210:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043047.735212:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789043047.735221:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789043047.735265:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789043047.735276:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6fc27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+20:3313:x1875947267643904:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789043047.735277:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6fc24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267644288:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789043047.735298:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789043047.735313:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a6fc29a00/0x99260d7389c05f16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x99260d7389c05f0f expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043047.735324:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789043047.735327:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:01000004:2.0:1789043047.735363:0:13079:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1789043047.735367:0:13079:0:(obd_config.c:2575:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000100:00100000:1.0:1789043047.735367:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6fc27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3313:x1875947267643904:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (1326us total) trans 0 rc 0/0 00000020:00000080:2.0:1789043047.735373:0:13079:0:(obd_config.c:1570:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789043047.735379:0:13079:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1789043047.735385:0:13079:0:(genops.c:1827:print_export_data()) lustre-MDT0000: ACTIVE ffffa06a45301000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789043047.735390:0:13079:0:(genops.c:1827:print_export_data()) lustre-MDT0000: ACTIVE ffffa06941212800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789043047.735395:0:13079:0:(genops.c:1561:class_disconnect_exports()) OBD device 5 (ffffa06a520999d8) has exports, disconnecting them 00000020:00080000:2.0:1789043047.735400:0:13079:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffffa06a45301000), last request at 1789043047 00000020:00000080:2.0:1789043047.735409:0:13079:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x99260d7389c05df0 00000100:00080000:2.0:1789043047.735424:0:13079:0:(import.c:65:import_set_state_nolock()) ffffa06a45306000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789043047.735473:0:13079:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffffa06a45301000): rc 0 00000020:00000080:2.0:1789043047.735476:0:13079:0:(genops.c:893:class_export_put()) final put ffffa06a45301000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1789043047.735489:0:13079:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffffa06941212800), last request at 1789043047 00000020:00000080:2.0:1789043047.735492:0:13079:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x99260d7389c05d25 00000100:00080000:2.0:1789043047.735497:0:13079:0:(import.c:65:import_set_state_nolock()) ffffa06941217800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789043047.735509:0:13079:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffffa06941212800): rc 0 00000020:00000080:2.0:1789043047.735511:0:13079:0:(genops.c:893:class_export_put()) final put ffffa06941212800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1789043047.735539:0:13079:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffafe141a1fae0 00000100:00080000:2.0:1789043047.735566:0:13079:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789043047.735569:0:13079:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1789043047.735583:0:13079:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789043047.735661:0:13079:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789043047.735675:0:13079:0:(import.c:65:import_set_state_nolock()) ffffa06a52b66000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789043047.735697:0:13079:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789043047.735699:0:13079:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1789043047.735709:0:13079:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789043047.735891:0:13079:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789043047.735980:0:13079:0:(import.c:65:import_set_state_nolock()) ffffa06a45300000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1789043047.736018:0:13079:0:(genops.c:1566:class_disconnect_exports()) OBD device 5 (ffffa06a520999d8) has no exports 00000100:00100000:2.0:1789043047.736888:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267644288 00000100:00100000:2.0:1789043047.736901:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267644288 00000020:00000080:3.0:1789043047.737064:0:470:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a45301000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1789043047.737129:0:470:0:(genops.c:852:class_export_destroy()) destroying export ffffa06941212800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789043047.737158:0:470:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffffa06a45306000 for lustre-MDT0000 00000020:00000080:3.0:1789043047.737164:0:470:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffffa06941217800 for lustre-MDT0000 00000100:00100000:0.0:1789043047.737181:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789043047.737197:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a026d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+20:3315:x1875947267644160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789043047.737214:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789043047.737239:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a413a1200/0x99260d7389c06131 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x99260d7389c0612a expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043047.737257:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789043047.737347:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a026d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+19:3315:x1875947267644160:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (3274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043047.737369:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789043047.737396:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789043047.737404:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6edb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+18:3314:x1875947267644032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789043047.737413:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789043047.737424:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a40030e00/0x99260d7389c05e2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x99260d7389c05e28 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043047.737438:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789043047.737464:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6edb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+17:3314:x1875947267644032:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (3257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043047.737470:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789043047.737546:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6fc26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3314:1875947267644032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789043047.737579:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875947267644416:0@lo:9:umount.0 00000100:00100000:0.0:1789043047.737623:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043047.737649:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875947267644544:0@lo:9:umount.0 00000100:00100000:0.0:1789043047.737672:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789043047.737710:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789043047.737711:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1789043047.737748:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789043047.737777:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267643904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789043047.742167:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267644416 00000100:00100000:3.0:1789043047.742192:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267644416 00000100:00100000:3.0:1789043047.742262:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267644544 00000100:00100000:3.0:1789043047.742266:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267644544 00000100:00100000:3.0:1789043047.742297:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789043047.742308:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875947267644416:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789043047.742350:0:6691:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x99260d7389c05d72 00000100:00080000:3.0:1789043047.742362:0:6691:0:(import.c:65:import_set_state_nolock()) ffffa06a52b61000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789043047.742409:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1789043047.743071:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3311:x1875947267644416:12345-0@lo:9:umount.0 Request processed in 761us (5444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043047.743081:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789043047.743102:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789043047.743110:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875947267644544:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789043047.743129:0:6691:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x99260d7389c05e59 00000100:00080000:3.0:1789043047.743137:0:6691:0:(import.c:65:import_set_state_nolock()) ffffa06a6fe4e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789043047.743165:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1789043047.743380:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3311:x1875947267644544:12345-0@lo:9:umount.0 Request processed in 271us (5706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043047.743408:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:3.0:1789043047.743438:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043047.743449:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789043047.743491:0:3311:0:(import.c:65:import_set_state_nolock()) ffffa06a52b66000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789043047.743509:0:3311:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00100000:2.0:1789043047.743725:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789043047.743747:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6fc27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+15:3313:x1875947267644288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789043047.743763:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789043047.743791:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a58605e00/0x99260d7389c05be3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x99260d7389c05bdc expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043047.743814:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789043047.743859:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6fc27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3de3a1ea-f793-48e7-82dd-f3f40cc922f9+14:3313:x1875947267644288:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (8533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043047.743866:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789043047.743901:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6fc24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267644288:0@lo:103:ldlm_bl.0 00000004:00080000:3.0:1789043047.749184:0:3311:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789043047.749203:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875947267644416:0@lo:9:umount.0 00000100:00080000:3.0:1789043047.749260:0:3311:0:(import.c:65:import_set_state_nolock()) ffffa06a45300000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789043047.749289:0:3311:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789043047.749291:0:3311:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789043047.749294:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875947267644544:0@lo:9:umount.0 00000100:00100000:3.0:1789043047.749372:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3315:1875947267644160:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1789043047.757151:0:13079:0:(genops.c:1566:class_disconnect_exports()) OBD device 5 (ffffa06a520999d8) has no exports 00010000:00010000:1.0:1789043047.794661:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789043047.810499:0:13079:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x99260d7389c05c37 00000020:00000080:3.0:1789043047.812026:0:13079:0:(genops.c:893:class_export_put()) final put ffffa06a77372800/lustre-QMT0000_UUID 00000020:01000000:3.0:1789043047.812050:0:13079:0:(obd_config.c:2575:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1789043047.812152:0:13079:0:(obd_config.c:1570:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789043047.812170:0:13079:0:(obd_config.c:1048:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789043047.812174:0:13079:0:(genops.c:1566:class_disconnect_exports()) OBD device 7 (ffffa06a77328000) has no exports 00000020:00000080:2.0:1789043047.812817:0:13079:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x99260d7389c05c30 00000020:00000080:2.0:1789043047.812827:0:13079:0:(genops.c:893:class_export_put()) final put ffffa06a77330000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789043047.812872:0:13079:0:(obd_config.c:1570:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789043047.812880:0:13079:0:(obd_config.c:958:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789043047.816368:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a77372800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1789043047.816385:0:36:0:(genops.c:893:class_export_put()) final put ffffa06a75ed2000/lustre-QMT0000_UUID 00000020:00000080:0.0:1789043047.816388:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a75ed2000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1789043047.816404:0:36:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1789043047.816626:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a77330000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1789043047.816829:0:13079:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffffa06a7725d200 - data ffffa06a7fc161b0/ffffa06a79efb000 00000020:01000000:2.0:1789043047.816982:0:13079:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffffa06a46eb5a00 - data ffffa06a6caf90d8/ffffa06a7a8cfc00 00000001:00000004:2.0:1789043047.826984:0:13079:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1789043047.990766:0:13079:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789043047.990773:0:13079:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1789043047.990785:0:13079:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789043047.990787:0:13079:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789043047.997773:0:6741:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789043047.997781:0:6741:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:3.0:1789043047.997793:0:6741:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1789043048.000291:0:13079:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789043048.000298:0:13079:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1789043048.000331:0:13079:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789043048.000334:0:13079:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789043048.001040:0:7894:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789043048.001045:0:7894:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:3.0:1789043048.001054:0:7894:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1789043048.136281:0:13079:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x99260d7389c05bff 00000020:00000080:0.0:1789043048.136297:0:13079:0:(genops.c:893:class_export_put()) final put ffffa06a79a11000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789043048.136376:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a79a11000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789043048.144766:0:13079:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x99260d7389c05c14 00000020:00000080:1.0:1789043048.144779:0:13079:0:(genops.c:893:class_export_put()) final put ffffa06a7a073800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789043048.144799:0:13079:0:(obd_config.c:2575:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1789043048.144806:0:13079:0:(obd_config.c:1570:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789043048.144814:0:13079:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789043048.144818:0:13079:0:(genops.c:1566:class_disconnect_exports()) OBD device 4 (ffffa06a52098000) has no exports 00000004:01000000:1.0:1789043048.144993:0:13079:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789043048.145001:0:13079:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x99260d7389c05e52 00000020:00000080:1.0:1789043048.145004:0:13079:0:(genops.c:893:class_export_put()) final put ffffa06a6fe49000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789043048.145008:0:13079:0:(obd_config.c:2575:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789043048.145012:0:13079:0:(obd_config.c:1570:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789043048.145018:0:13079:0:(obd_config.c:1048:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789043048.145021:0:13079:0:(genops.c:1566:class_disconnect_exports()) OBD device 17 (ffffa06a7732cd88) has no exports 00000020:00000080:1.0:1789043048.145028:0:13079:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x99260d7389c05e4b 00000020:00000080:1.0:1789043048.145031:0:13079:0:(genops.c:893:class_export_put()) final put ffffa06a45306800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1789043048.145382:0:13079:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789043048.145387:0:13079:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789043048.145391:0:13079:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1789043048.145397:0:13079:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789043048.145408:0:13079:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789043048.145443:0:13079:0:(obd_config.c:1570:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789043048.145450:0:13079:0:(obd_config.c:958:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789043048.145455:0:13079:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x99260d7389c05d6b 00000020:00000080:1.0:1789043048.145459:0:13079:0:(genops.c:893:class_export_put()) final put ffffa06a7ab57000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789043048.145467:0:13079:0:(obd_config.c:2575:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789043048.145470:0:13079:0:(obd_config.c:1570:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789043048.145474:0:13079:0:(obd_config.c:1048:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789043048.145476:0:13079:0:(genops.c:1566:class_disconnect_exports()) OBD device 13 (ffffa06a47340000) has no exports 00000020:00000080:1.0:1789043048.145480:0:13079:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x99260d7389c05d64 00000020:00000080:1.0:1789043048.145483:0:13079:0:(genops.c:893:class_export_put()) final put ffffa06a52b65000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1789043048.145886:0:13079:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789043048.145890:0:13079:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789043048.145892:0:13079:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1789043048.145896:0:13079:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789043048.145897:0:13079:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789043048.145920:0:13079:0:(obd_config.c:1570:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789043048.145924:0:13079:0:(obd_config.c:958:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789043048.145945:0:13079:0:(obd_config.c:1570:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789043048.145947:0:13079:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789043048.145973:0:13079:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x99260d7389c05c1b 00000020:00000080:1.0:1789043048.145977:0:13079:0:(genops.c:893:class_export_put()) final put ffffa06a7a077000/lustre-MDD0000_UUID 00000020:01000000:1.0:1789043048.145980:0:13079:0:(obd_config.c:2575:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1789043048.145983:0:13079:0:(obd_config.c:1570:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789043048.145986:0:13079:0:(obd_config.c:1048:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789043048.145988:0:13079:0:(genops.c:1566:class_disconnect_exports()) OBD device 6 (ffffa06a5209b3b0) has no exports 00000020:00000080:1.0:1789043048.146002:0:13079:0:(obd_config.c:1570:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789043048.146005:0:13079:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1789043048.146008:0:13079:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x99260d7389c05c22 00000020:00000080:1.0:1789043048.146011:0:13079:0:(genops.c:893:class_export_put()) final put ffffa06a7a076800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789043048.146017:0:13079:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa06a52b8e800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1789043048.146020:0:13079:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa06a52b8e800 3 00000020:01000004:1.0:1789043048.146023:0:13079:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa06a52b8e800 from lustre-MDT0000 00000020:00000080:1.0:1789043048.146043:0:13079:0:(obd_config.c:1570:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789043048.146047:0:13079:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1789043048.146051:0:13079:0:(genops.c:893:class_export_put()) final put ffffa06a79a10000/lustre-MDT0000_UUID 00000020:00000080:1.0:1789043048.146054:0:13079:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a79a10000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1789043048.146067:0:13079:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1789043048.146135:0:13079:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1789043048.146138:0:13079:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1789043048.146140:0:13079:0:(obd_config.c:2575:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1789043048.146143:0:13079:0:(obd_config.c:1570:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789043048.146145:0:13079:0:(obd_config.c:1048:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789043048.146151:0:13079:0:(genops.c:1827:print_export_data()) MGS: ACTIVE ffffa06a52cd0800 3de3a1ea-f793-48e7-82dd-f3f40cc922f9 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789043048.146156:0:13079:0:(genops.c:1561:class_disconnect_exports()) OBD device 1 (ffffa06a52ca19d8) has exports, disconnecting them 00000020:00080000:1.0:1789043048.146160:0:13079:0:(genops.c:1536:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffffa06a52cd0800), last request at 1789042808 00000020:00000080:1.0:1789043048.146173:0:13079:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x99260d7389c05bc0 00000020:00010000:1.0:1789043048.146177:0:13079:0:(genops.c:1929:obd_stale_export_put()) Put export ffffa06a52cd0800: total 7 00000100:00080000:1.0:1789043048.146181:0:13079:0:(import.c:65:import_set_state_nolock()) ffffa06a52cd5000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789043048.146203:0:13079:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffffa06a52cd0800): rc 0 00000020:00080000:1.0:1789043048.146207:0:13079:0:(genops.c:1566:class_disconnect_exports()) OBD device 1 (ffffa06a52ca19d8) has no exports 00000100:00100000:1.0:1789043048.146257:0:5840:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffffa06a472f9400:5840] 1 exiting: rc = 0 00000100:00100000:3.0:1789043048.146399:0:5841:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffffa06a52b6c400:5841] 2 exiting: rc = 0 00000020:00000080:3.0:1789043048.146442:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a7a073800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1789043048.146447:0:36:0:(genops.c:893:class_export_put()) final put ffffa06a79a16800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789043048.146449:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a79a16800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1789043048.146453:0:36:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789043048.146589:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a6fe49000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789043048.146594:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a45306800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789043048.146600:0:36:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffffa06a45300000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789043048.146604:0:36:0:(genops.c:893:class_export_put()) final put ffffa06a7fa97800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789043048.146606:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a7fa97800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1789043048.146609:0:36:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789043048.146638:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a7ab57000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789043048.146645:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a52b65000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789043048.146651:0:36:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffffa06a52b66000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789043048.146656:0:36:0:(genops.c:893:class_export_put()) final put ffffa069412e9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789043048.146658:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffffa069412e9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1789043048.146662:0:36:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00010000:0.0:1789043048.146679:0:5835:0:(genops.c:1915:obd_stale_export_get()) Get export ffffa06a52cd0800: total 2 00000020:00000080:3.0:1789043048.146756:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a7a077000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1789043048.146761:0:36:0:(genops.c:893:class_export_put()) final put ffffa06a55f6e000/lustre-MDD0000_UUID 00000020:00000080:3.0:1789043048.146763:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a55f6e000/lustre-MDD0000_UUID for lustre-MDD0000 00010000:00010000:0.0:1789043048.146765:0:5835:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa06a52cd0800, canceled 0 locks, left on hash table 8. 00000020:01000000:3.0:1789043048.146768:0:36:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00010000:00010000:0.0:1789043048.146832:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a41687a00/0x99260d7389c05ede lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x99260d7389c05ed7 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043048.146862:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a40030600/0x99260d7389c05ed0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x99260d7389c05ec9 expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043048.146879:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a6fc29800/0x99260d7389c05eec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x99260d7389c05ee5 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043048.146894:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a58604000/0x99260d7389c05efa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x99260d7389c05ef3 expref: 6 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043048.146916:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a50978c00/0x99260d7389c06123 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x99260d7389c0611c expref: 5 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043048.146936:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a58605800/0x99260d7389c05cd8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x99260d7389c05cd1 expref: 4 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043048.146966:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a6fc28e00/0x99260d7389c06115 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x99260d7389c0610e expref: 3 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1789043048.146989:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a7a076800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1789043048.148108:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a41687800/0x99260d7389c05f24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x99260d7389c05f1d expref: 2 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043048.148146:0:5835:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa06a52cd0800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1789043048.148772:0:5835:0:(genops.c:893:class_export_put()) final put ffffa06a52cd0800/3de3a1ea-f793-48e7-82dd-f3f40cc922f9 00010000:00010000:0.0:1789043048.148805:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043048.148808:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043048.148811:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789043048.148848:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a52cd0800/3de3a1ea-f793-48e7-82dd-f3f40cc922f9 for MGS 00000100:00100000:0.0:1789043048.148867:0:5839:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffffa06a43ca0400:5839] 0 exiting: rc = 1 00000020:00000080:3.0:1789043048.148900:0:36:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffffa06a52cd5000 for MGS 00000100:00100000:0.0:1789043048.149816:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.149826:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.149835:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.149842:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.149848:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.149862:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.149868:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150036:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150045:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150053:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150059:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150066:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150072:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150079:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150088:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150097:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150104:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150110:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150117:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150123:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150129:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150140:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150149:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150157:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150573:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150581:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150609:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150615:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150621:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150630:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150640:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150646:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150655:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150662:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150668:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150674:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150680:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150699:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150705:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150710:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150716:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150723:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150729:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150735:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150740:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150747:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150752:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150757:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150762:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150768:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150774:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150779:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150785:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150790:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150796:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150802:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150808:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150815:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150820:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150826:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150835:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150847:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150852:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.150858:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1789043048.152807:0:13079:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789043048.152817:0:13079:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1789043048.161406:0:13079:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffffa06a52bd3e80 - data ffffa06a7fc79af8/ffffa06a77306400 00000020:01000000:0.0:1789043048.161713:0:13079:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffffa06a473ccf00 - data ffffa06a58fdb360/ffffa06a520dd400 00000020:00000080:0.0:1789043048.163644:0:13079:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x99260d7389c05ba4 00000020:00000080:0.0:1789043048.163658:0:13079:0:(genops.c:893:class_export_put()) final put ffffa06a528cf000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789043048.163757:0:13079:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa06a52b8e800 from MGS, refs=2 00000020:01000004:0.0:1789043048.163761:0:13079:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa06a52b8e800 2 00000020:01000004:0.0:1789043048.163765:0:13079:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa06a52b8e800 from MGS 00000020:00000080:0.0:1789043048.163799:0:13079:0:(obd_config.c:1570:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789043048.163807:0:13079:0:(obd_config.c:958:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1789043048.163811:0:13079:0:(genops.c:893:class_export_put()) final put ffffa06a52ada000/MGS 00000020:00000080:0.0:1789043048.163814:0:13079:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a52ada000/MGS for MGS 00000020:01000000:0.0:1789043048.163823:0:13079:0:(genops.c:443:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1789043048.163909:0:13079:0:(obd_config.c:2575:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1789043048.163915:0:13079:0:(obd_config.c:1570:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789043048.163920:0:13079:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789043048.163929:0:13079:0:(genops.c:1827:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffffa06a77333800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789043048.163934:0:13079:0:(genops.c:1561:class_disconnect_exports()) OBD device 8 (ffffa06a773299d8) has exports, disconnecting them 00000020:00080000:0.0:1789043048.163940:0:13079:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffffa06a77333800), last request at 1789042809 00000020:00000080:0.0:1789043048.163945:0:13079:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x99260d7389c05c6f 00000020:00080000:0.0:1789043048.163957:0:13079:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffffa06a77333800): rc 0 00000020:00000080:0.0:1789043048.163963:0:13079:0:(genops.c:893:class_export_put()) final put ffffa06a77333800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789043048.166110:0:470:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a528cf000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789043048.167896:0:470:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a77333800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1789043048.229592:0:13079:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1789043048.229600:0:13079:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789043048.229605:0:13079:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789043048.229612:0:13079:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789043048.229857:0:13079:0:(obd_config.c:1570:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789043048.229866:0:13079:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1789043048.229873:0:13079:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa06a52b8e800 1 00000020:00000080:3.0:1789043048.229879:0:13079:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x99260d7389c05b96 00000020:00000080:3.0:1789043048.229888:0:13079:0:(genops.c:893:class_export_put()) final put ffffa06a52add000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1789043048.229907:0:13079:0:(obd_config.c:2575:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1789043048.229912:0:13079:0:(obd_config.c:1570:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789043048.229916:0:13079:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789043048.229920:0:13079:0:(genops.c:1566:class_disconnect_exports()) OBD device 0 (ffffa06a473419d8) has no exports 00000020:00000080:1.0:1789043048.233430:0:470:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffffa06a77330800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789043048.233448:0:470:0:(genops.c:893:class_export_put()) final put ffffa06a77336000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1789043048.233452:0:470:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a77336000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1789043048.233470:0:470:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1789043048.233586:0:470:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a52add000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789043048.325676:0:13079:0:(obd_config.c:1570:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789043048.325735:0:13079:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1789043048.325741:0:13079:0:(genops.c:893:class_export_put()) final put ffffa06a52b8d000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789043048.325745:0:13079:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a52b8d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789043048.325751:0:13079:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1789043048.325879:0:13079:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffffa06a52b88800 00000020:01000000:0.0:1789043048.325900:0:13079:0:(obd_config.c:2575:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1789043048.325904:0:13079:0:(obd_config.c:1570:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789043048.325908:0:13079:0:(obd_config.c:1048:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789043048.325912:0:13079:0:(genops.c:1566:class_disconnect_exports()) OBD device 3 (ffffa06a473433b0) has no exports 00000100:00100000:0.0:1789043048.325986:0:5846:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffffa06a44fc7200:5846] 1 exiting: rc = 0 00000100:00100000:1.0:1789043048.326125:0:6714:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffffa06a4721bc00:6714] 3 exiting: rc = 0 00000100:00100000:1.0:1789043048.326198:0:5847:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffffa06a520c9c00:5847] 2 exiting: rc = 0 00000100:00100000:2.0:1789043048.326585:0:5845:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffffa06a520c9e00:5845] 0 exiting: rc = 1 00000100:00100000:2.0:1789043048.326659:0:11703:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffffa06a6edcce00:11703] 4 exiting: rc = 0 00000100:00100000:0.0:1789043048.326875:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.326883:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.326888:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.326897:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.326903:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.326909:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.326914:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.326920:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.326925:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.326931:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.326935:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.326941:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.326946:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.326951:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.326956:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.326962:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.326967:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.326973:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.326978:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.326984:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.326989:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.326995:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327000:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327005:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327010:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327014:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327019:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327024:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327030:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327043:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327049:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327055:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327059:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327064:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327069:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327074:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327080:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327085:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327091:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327096:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327101:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327107:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327113:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327118:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327123:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327129:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327133:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327138:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327143:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327148:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327153:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327167:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327173:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327180:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327185:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327190:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327196:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327201:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327207:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327212:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327217:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327223:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327228:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.327241:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789043048.334098:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffffa06a4739f800:5848] 0 exiting: rc = 1 00000100:00100000:3.0:1789043048.334151:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffffa06a520c9a00:5849] 1 exiting: rc = 0 00000100:00100000:0.0:1789043048.334281:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334289:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334295:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334303:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334309:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334315:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334321:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334326:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334331:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334337:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334343:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334351:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334358:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334363:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334368:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334373:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334378:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334383:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334389:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334395:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334401:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334407:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334412:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334416:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334421:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334426:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334432:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334437:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334442:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334447:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334452:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334457:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334462:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334467:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334472:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334487:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334492:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334497:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334502:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334507:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334512:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334541:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334548:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334553:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334558:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334564:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334569:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334574:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334579:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334584:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334590:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334595:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334600:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334604:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334609:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334614:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334619:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334623:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334628:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334633:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334644:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334649:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334654:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.334660:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.335336:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffffa06a4739f400:5851] 1 exiting: rc = 0 00000100:00100000:2.0:1789043048.349488:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffffa06a520c8400:5850] 0 exiting: rc = 1 00000100:00100000:3.0:1789043048.350113:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350122:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350131:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350140:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350147:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350154:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350160:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350166:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350172:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350178:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350184:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350190:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350197:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350203:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350209:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350232:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350238:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350244:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350250:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350256:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350262:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350268:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350274:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350280:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350286:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350291:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350297:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350317:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350324:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350330:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350345:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350350:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350356:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350362:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350368:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350374:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350380:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350388:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350393:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350413:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350421:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350426:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350432:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350439:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350445:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350450:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350456:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350462:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350468:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350475:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350480:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350502:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350510:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350533:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350540:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350547:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350552:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350558:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350563:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350569:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350575:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350580:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350587:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.350597:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789043048.372378:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffffa06a50c52a00:5853] 1 exiting: rc = 0 00000100:00100000:1.0:1789043048.380344:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffffa06a50c50000:5852] 0 exiting: rc = 1 00000100:00100000:3.0:1789043048.380504:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380539:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380545:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380554:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380573:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380582:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380587:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380597:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380605:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380610:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380615:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380621:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380626:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380631:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380636:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380642:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380646:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380651:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380656:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380661:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380679:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380693:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380699:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380704:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380709:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380714:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380718:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380723:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380728:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380733:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380738:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380743:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380748:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380754:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380760:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380765:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380778:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380784:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380789:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380794:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380799:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380804:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380809:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380813:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380818:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380823:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380828:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380833:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380838:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380843:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380848:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380852:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380859:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380865:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380872:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380879:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380885:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380892:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380899:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380904:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380910:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380914:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380919:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.380924:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.381296:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffffa06a50c50200:5854] 0 exiting: rc = 1 00000100:00100000:1.0:1789043048.381534:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffffa06a50c52600:5855] 1 exiting: rc = 0 00000100:00100000:3.0:1789043048.381639:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.381646:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.381653:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.381659:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382180:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382190:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382205:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382214:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382221:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382225:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382230:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382235:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382240:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382244:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382250:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382255:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382259:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382264:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382268:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382273:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382278:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382282:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382286:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382290:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382294:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382299:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382303:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382307:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382312:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382317:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382322:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382326:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382330:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382335:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382339:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382344:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382349:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382354:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382359:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382365:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382371:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382384:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382389:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382393:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382398:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382403:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382409:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382415:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382420:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382425:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382430:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382435:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382440:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382445:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382450:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382456:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382461:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382466:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382471:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382476:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382480:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382485:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382490:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.382495:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.383227:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffffa06a791b8e00:5857] 1 exiting: rc = 0 00000100:00100000:0.0:1789043048.384797:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffffa06a791b8c00:5856] 0 exiting: rc = 1 00000100:00100000:3.0:1789043048.385198:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385206:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385211:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385217:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385223:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385230:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385236:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385241:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385251:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385290:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385295:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385311:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385316:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385322:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385327:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385332:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385337:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385343:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385347:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385352:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385358:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385363:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385368:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385373:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385377:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385382:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385387:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385392:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385397:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385403:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385408:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385413:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385418:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385424:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385429:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385435:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385440:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385446:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385451:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385456:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385461:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385467:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385472:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385477:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385481:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385486:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385500:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385505:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385511:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385546:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385554:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385625:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385634:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385642:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385649:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385657:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385730:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385739:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385744:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385749:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385754:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385758:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385763:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.385769:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789043048.386602:0:5859:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffffa06a791b9a00:5859] 1 exiting: rc = 0 00000100:00100000:0.0:1789043048.386891:0:5858:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffffa06a505b7200:5858] 0 exiting: rc = 1 00000100:00100000:3.0:1789043048.387413:0:5860:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffffa06a505b7400:5860] 2 exiting: rc = 0 00000100:00100000:3.0:1789043048.387491:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.387498:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.387504:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.387509:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.387540:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.387546:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.387554:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388149:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388160:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388166:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388172:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388178:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388186:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388191:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388197:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388203:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388218:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388238:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388246:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388253:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388260:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388266:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388273:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388281:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388290:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388297:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388304:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388309:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388316:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388323:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388330:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388337:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388344:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388349:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388356:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388361:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388367:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388372:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388377:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388382:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388387:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388407:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388415:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388423:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388430:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388437:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388444:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388451:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388458:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388466:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388471:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388482:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388488:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388494:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388499:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388505:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388511:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388553:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.388561:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.389258:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.389265:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.389273:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.389279:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789043048.389286:0:13079:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789043048.397618:0:13079:0:(obd_config.c:1570:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789043048.397631:0:13079:0:(obd_config.c:958:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1789043048.397637:0:13079:0:(genops.c:893:class_export_put()) final put ffffa06a55f68800/MDS_uuid 00000020:00000080:3.0:1789043048.397641:0:13079:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a55f68800/MDS_uuid for MDS 00000020:01000000:3.0:1789043048.397648:0:13079:0:(genops.c:443:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1789043048.397816:0:13079:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1789043048.819730:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043049.843364:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043050.872058:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789043051.130886:0:13228:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1789043051.149265:0:13228:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1789043051.149314:0:13228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41686c00/0x99260d7389c05ee5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05eec expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043051.149330:0:13228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41686c00/0x99260d7389c05ee5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05eec expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043051.149338:0:13228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41686c00/0x99260d7389c05ee5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x99260d7389c05eec expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043051.149345:0:13228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffffa06a41686c00/0x99260d7389c05ee5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x99260d7389c05eec expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043051.149383:0:13228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789043051.149389:0:13228:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1789043051.149412:0:11175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789043051.149419:0:11175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a41686c00/0x99260d7389c05ee5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x99260d7389c05eec expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043051.149426:0:11175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686c00 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:3.0:1789043051.149430:0:11175:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a41686c00/0x99260d7389c05ee5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x99260d7389c05eec expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043051.149439:0:11175:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a41686c00/0x99260d7389c05ee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x99260d7389c05eec expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789043051.149447:0:11175:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a41686c00/0x99260d7389c05ee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x99260d7389c05eec expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789043051.149452:0:11175:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789043051.149455:0:11175:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789043051.149457:0:11175:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789043051.149494:0:11175:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a41686c00/0x99260d7389c05ee5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x99260d7389c05eec expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043051.149500:0:11175:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789043051.149562:0:11175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a41686c00/0x99260d7389c05ee5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x99260d7389c05eec expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043051.149570:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a41686c00/0x99260d7389c05ee5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x99260d7389c05eec expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043051.149582:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043051.149589:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043051.149591:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789043051.149617:0:13228:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789043051.149621:0:13228:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789043051.149627:0:13228:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789043051.149641:0:13228:0:(import.c:65:import_set_state_nolock()) ffffa069412fd800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789043051.149676:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875947267644800:0@lo:39:umount.0 00000400:00000100:3.0:1789043051.149946:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875947267644800 offset 0 length 224: 4 00000100:00100000:2.0:1789043051.150211:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267644672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789043051.150257:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043051.150775:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267644672 00000100:00100000:3.0:1789043051.150784:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267644672 00000100:00100000:3.0:1789043051.150833:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789043051.150841:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3313:x1875947267644672:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789043051.150847:0:6705:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789043051 with bad export cookie 11035522726801464256 00000100:00100000:0.0:1789043051.168773:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3313:x1875947267644672:12345-0@lo:103:ldlm_bl.0 Request processed in 17923us (18508us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789043051.168800:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1789043051.169450:0:3313:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.117@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789043051.169456:0:3313:0:(import.c:65:import_set_state_nolock()) ffffa06a48454800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1789043051.169461:0:3313:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1789043051.181704:0:3313:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.117@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1789043051.181710:0:3313:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789043051.181722:0:3313:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffffa06a7a027800 x1875947267644672/t0(0) o103->MGC192.168.203.117@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789043067 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789043051.181736:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789043051.181739:0:3313:0:(pinger.c:194:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789043051.181741:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789043051.181745:0:3313:0:(import.c:65:import_set_state_nolock()) ffffa06a48454800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789043051.181750:0:3313:0:(import.c:545:import_select_connection()) MGC192.168.203.117@tcp: connect to NID 0@lo last attempt 151 00000100:00080000:3.0:1789043051.181759:0:3313:0:(import.c:665:import_select_connection()) MGC192.168.203.117@tcp: import ffffa06a48454800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:3.0:1789043051.181788:0:3313:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa06a7a024a80 x1875947267644928/t0(0) o250->MGC192.168.203.117@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789043051.181835:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3313:1875947267644672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789043051.182358:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a024a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3311:1875947267644928:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:0.0:1789043051.182579:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875947267644928 offset 0 length 520: 4 00010000:00010000:2.0:1789043051.890840:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789043052.358035:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789043052.358306:0:6716:0:(genops.c:893:class_export_put()) final put ffffa06a52b60000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789043052.358353:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a52b60000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789043052.358434:0:36:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffffa06a52b61000 for lustre-OST0000 00000001:00100000:3.0:1789043052.364029:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789043052.364101:0:7647:0:(genops.c:893:class_export_put()) final put ffffa06a6fe4a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789043052.364185:0:470:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a6fe4a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1789043052.364241:0:470:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffffa06a6fe4e800 for lustre-OST0001 00000100:00080000:3.0:1789043052.788954:0:36:0:(pinger.c:230:ptlrpc_pinger_process_import()) 3de3a1ea-f793-48e7-82dd-f3f40cc922f9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789043052.788968:0:36:0:(pinger.c:248:ptlrpc_pinger_process_import()) 3de3a1ea-f793-48e7-82dd-f3f40cc922f9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789043052.789112:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789043052.789141:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875947267645056:0@lo:400:kworker.0 00000400:00000100:1.0:1789043052.789213:0:3315:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875947267645056 offset 0 length 224: 4 00010000:00010000:3.0:1789043052.916232:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043053.940637:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043054.963376:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043055.989909:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789043056.826948:0:36:0:(pinger.c:230:ptlrpc_pinger_process_import()) 3de3a1ea-f793-48e7-82dd-f3f40cc922f9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789043056.826961:0:36:0:(pinger.c:248:ptlrpc_pinger_process_import()) 3de3a1ea-f793-48e7-82dd-f3f40cc922f9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789043056.827231:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875947267645184:0@lo:400:kworker.0 00000400:00000100:3.0:1789043056.827317:0:3315:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875947267645184 offset 0 length 224: 4 00010000:00010000:3.0:1789043057.010797:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043058.038030:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043059.061641:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043060.082731:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043061.108034:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789043061.490835:0:3311:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789043051/real 1789043051] req@ffffa06a7a024a80 x1875947267644928/t0(0) o250->MGC192.168.203.117@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789043061 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789043061.490880:0:3311:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa06a7a024a80 x1875947267644928/t0(0) o250->MGC192.168.203.117@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789043061 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789043061.490893:0:3311:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789043051/real 1789043051] req@ffffa06a7a025f80 x1875947267644800/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789043061 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789043061.490907:0:3311:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa06a7a025f80 x1875947267644800/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789043061 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789043061.490930:0:3311:0:(import.c:65:import_set_state_nolock()) ffffa06a48454800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789043061.490961:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1789043061.490965:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a024a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3311:1875947267644928:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:0.0:1789043061.490972:0:3311:0:(import.c:65:import_set_state_nolock()) ffffa069412fd800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789043061.490990:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875947267644800:0@lo:39:umount.0 00000100:00080000:3.0:1789043061.491825:0:36:0:(pinger.c:230:ptlrpc_pinger_process_import()) 3de3a1ea-f793-48e7-82dd-f3f40cc922f9->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789043061.491834:0:36:0:(pinger.c:238:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1789043061.491837:0:36:0:(import.c:65:import_set_state_nolock()) ffffa06a48454800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789043061.491845:0:36:0:(import.c:545:import_select_connection()) MGC192.168.203.117@tcp: connect to NID 0@lo last attempt 394 00000100:00080000:3.0:1789043061.491852:0:36:0:(import.c:630:import_select_connection()) MGC192.168.203.117@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789043061.491862:0:36:0:(import.c:665:import_select_connection()) MGC192.168.203.117@tcp: import ffffa06a48454800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:3.0:1789043061.491911:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa06a7a026a00 x1875947267645312/t0(0) o250->MGC192.168.203.117@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789043061.492006:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789043061.492025:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875947267645440:0@lo:400:kworker.0 00000400:00000100:3.0:1789043061.492167:0:3313:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875947267645440 offset 0 length 224: 4 00000100:00080000:2.0:1789043061.492800:0:13228:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789043061.492818:0:13228:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789043061.492826:0:13228:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1789043061.493280:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3311:1875947267645312:0@lo:250:kworker.0 00000400:00000100:0.0:1789043061.493325:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875947267645312 offset 0 length 520: 4 00010000:00010000:2.0:1789043061.493747:0:13228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05ef3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05efa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043061.493764:0:13228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05ef3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05efa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043061.493771:0:13228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05ef3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x99260d7389c05efa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043061.493778:0:13228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05ef3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x99260d7389c05efa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043061.493826:0:13228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789043061.493835:0:13228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41686400/0x99260d7389c0611c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06123 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043061.493841:0:13228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41686400/0x99260d7389c0611c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c06123 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043061.493847:0:13228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41686400/0x99260d7389c0611c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x99260d7389c06123 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043061.493852:0:13228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffffa06a41686400/0x99260d7389c0611c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x99260d7389c06123 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043061.493877:0:13228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789043061.493882:0:13228:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1789043061.493909:0:13228:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1789043061.493914:0:13228:0:(obd_config.c:2575:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1789043061.493920:0:13228:0:(obd_config.c:1570:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789043061.493926:0:13228:0:(obd_config.c:1048:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789043061.493931:0:13228:0:(genops.c:1566:class_disconnect_exports()) OBD device 11 (ffffa06a7fae19d8) has no exports 00000020:00080000:2.0:1789043061.493961:0:13228:0:(genops.c:1566:class_disconnect_exports()) OBD device 11 (ffffa06a7fae19d8) has no exports 00010000:00010000:0.0:1789043061.496134:0:11175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789043061.496154:0:11175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05ef3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x99260d7389c05efa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043061.496169:0:11175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a40031e00 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:0.0:1789043061.496196:0:11175:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05ef3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x99260d7389c05efa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043061.496208:0:11175:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05ef3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x99260d7389c05efa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789043061.496216:0:11175:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05ef3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x99260d7389c05efa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789043061.496223:0:11175:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789043061.496226:0:11175:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1789043061.496230:0:11175:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1789043061.496254:0:11175:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa06a48454800 00010000:00010000:0.0:1789043061.496259:0:11175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05ef3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x99260d7389c05efa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043061.496267:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a40031e00/0x99260d7389c05ef3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x99260d7389c05efa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043061.496287:0:11175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789043061.496291:0:11175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a41686400/0x99260d7389c0611c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x99260d7389c06123 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043061.496297:0:11175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686400 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:0.0:1789043061.496300:0:11175:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a41686400/0x99260d7389c0611c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x99260d7389c06123 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043061.496307:0:11175:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a41686400/0x99260d7389c0611c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x99260d7389c06123 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789043061.496312:0:11175:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a41686400/0x99260d7389c0611c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x99260d7389c06123 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789043061.496325:0:11175:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789043061.496327:0:11175:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789043061.496329:0:11175:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789043061.496337:0:11175:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa06a48454800 00010000:00010000:0.0:1789043061.496340:0:11175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a41686400/0x99260d7389c0611c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x99260d7389c06123 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043061.496346:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a41686400/0x99260d7389c0611c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x99260d7389c06123 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043061.496355:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043061.496357:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043061.496359:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789043061.496985:0:13228:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffffa06a42fea300 - data ffffa06a7fe230d8/ffffa06941de6800 00000020:01000000:2.0:1789043061.497115:0:13228:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffffa06a77347d00 - data ffffa06a532fbd80/ffffa06a7fa8d000 00010000:00010000:3.0:1789043061.497554:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1789043061.527491:0:13228:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789043061.580261:0:13228:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x99260d7389c05cf4 00000020:00000080:3.0:1789043061.580275:0:13228:0:(genops.c:893:class_export_put()) final put ffffa06a7b797000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1789043061.580334:0:13228:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa06a7924c000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1789043061.580339:0:13228:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa06a7924c000 2 00000020:01000004:3.0:1789043061.580343:0:13228:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa06a7924c000 from lustre-OST0000 00000020:00000080:3.0:1789043061.580379:0:13228:0:(obd_config.c:1570:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789043061.580393:0:13228:0:(obd_config.c:958:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1789043061.580396:0:13228:0:(genops.c:893:class_export_put()) final put ffffa06a7b792000/lustre-OST0000_UUID 00000020:00000080:3.0:1789043061.580400:0:13228:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a7b792000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1789043061.580414:0:13228:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1789043061.580479:0:13228:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1789043061.580485:0:13228:0:(obd_config.c:2575:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789043061.580490:0:13228:0:(obd_config.c:1570:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789043061.580496:0:13228:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789043061.580505:0:13228:0:(genops.c:1827:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffffa069412fb800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789043061.580512:0:13228:0:(genops.c:1561:class_disconnect_exports()) OBD device 12 (ffffa06a52ca4d88) has exports, disconnecting them 00000020:00080000:3.0:1789043061.580537:0:13228:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffffa069412fb800), last request at 1789042828 00000020:00000080:3.0:1789043061.580542:0:13228:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x99260d7389c05d1e 00000020:00080000:3.0:1789043061.580551:0:13228:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffffa069412fb800): rc 0 00000020:00000080:3.0:1789043061.580557:0:13228:0:(genops.c:893:class_export_put()) final put ffffa069412fb800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789043061.580623:0:8:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a7b797000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00010000:01000000:3.0:1789043061.587177:0:13228:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1789043061.587191:0:13228:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789043061.587200:0:13228:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789043061.587210:0:13228:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789043061.588333:0:8:0:(genops.c:852:class_export_destroy()) destroying export ffffa069412fb800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789043061.591248:0:8:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffffa069412fd800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789043061.592058:0:13228:0:(obd_config.c:1570:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789043061.592489:0:13228:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1789043061.592498:0:13228:0:(genops.c:893:class_export_put()) final put ffffa06a79a15000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789043061.592503:0:13228:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a79a15000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1789043061.592864:0:13228:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1789043061.593397:0:13228:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa06a7924c000 1 00000020:00000080:3.0:1789043061.593407:0:13228:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x99260d7389c05cae 00000020:00000080:3.0:1789043061.593415:0:13228:0:(genops.c:893:class_export_put()) final put ffffa06a45303000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1789043061.593974:0:13228:0:(obd_config.c:2575:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1789043061.593982:0:13228:0:(obd_config.c:1570:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789043061.593992:0:13228:0:(obd_config.c:1048:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789043061.594001:0:13228:0:(genops.c:1566:class_disconnect_exports()) OBD device 9 (ffffa06a47344d88) has no exports 00000020:00000080:1.0:1789043061.594060:0:8:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a45303000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789043061.617282:0:13228:0:(obd_config.c:1570:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789043061.617303:0:13228:0:(obd_config.c:958:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1789043061.617310:0:13228:0:(genops.c:893:class_export_put()) final put ffffa06a79a12000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1789043061.617316:0:13228:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a79a12000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1789043061.617324:0:13228:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1789043061.617480:0:13228:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffffa06a79249800 00000020:02000400:3.0:1789043061.617559:0:13228:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1789043062.130759:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043063.158319:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789043064.129147:0:13384:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1789043064.139830:0:13384:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1789043064.139901:0:13384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a58604c00/0x99260d7389c05ec9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05ed0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043064.139915:0:13384:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a58604c00/0x99260d7389c05ec9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05ed0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043064.139922:0:13384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a58604c00/0x99260d7389c05ec9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x99260d7389c05ed0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043064.139930:0:13384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffffa06a58604c00/0x99260d7389c05ec9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x99260d7389c05ed0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043064.139957:0:13384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789043064.139962:0:13384:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789043064.139982:0:13384:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789043064.140002:0:13384:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffffa06a7a027800 x1875947267645056/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789043068 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789043064.140018:0:13384:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffffa06a7f8c5f80 x1875947267645184/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789043072 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789043064.140027:0:13384:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffffa06a7a026680 x1875947267645440/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789043077 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789043064.140039:0:13384:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1789043064.140079:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875947267645440:0@lo:400:kworker.0 00000100:00080000:0.0:1789043064.140107:0:13384:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789043064.140129:0:13384:0:(import.c:65:import_set_state_nolock()) ffffa06a7656e800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789043064.140154:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875947267645568:0@lo:39:umount.0 00000400:00000100:0.0:1789043064.140198:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875947267645568 offset 0 length 224: 4 00010000:00010000:2.0:1789043064.140463:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789043064.140471:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a58604c00/0x99260d7389c05ec9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x99260d7389c05ed0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043064.140479:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a58604c00 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:2.0:1789043064.140490:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a58604c00/0x99260d7389c05ec9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x99260d7389c05ed0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043064.140499:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a58604c00/0x99260d7389c05ec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x99260d7389c05ed0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789043064.140506:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a58604c00/0x99260d7389c05ec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x99260d7389c05ed0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789043064.140542:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789043064.140546:0:5835:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789043064.140548:0:5835:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789043064.140561:0:5835:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa06a48454800 00010000:00010000:2.0:1789043064.140565:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a58604c00/0x99260d7389c05ec9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x99260d7389c05ed0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043064.140672:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a58604c00/0x99260d7389c05ec9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x99260d7389c05ed0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043064.140686:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043064.140688:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043064.140690:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789043064.141695:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875947267645184:0@lo:400:kworker.0 00000100:00100000:0.0:1789043064.141708:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875947267645056:0@lo:400:kworker.0 00010000:00010000:2.0:1789043064.182268:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043065.202737:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043066.226848:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789043066.610728:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) 3de3a1ea-f793-48e7-82dd-f3f40cc922f9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789043066.610738:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) 3de3a1ea-f793-48e7-82dd-f3f40cc922f9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1789043067.250738:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043068.275322:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043069.298803:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043070.324420:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043071.347683:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789043071.731587:0:36:0:(pinger.c:230:ptlrpc_pinger_process_import()) 3de3a1ea-f793-48e7-82dd-f3f40cc922f9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789043071.731613:0:36:0:(pinger.c:248:ptlrpc_pinger_process_import()) 3de3a1ea-f793-48e7-82dd-f3f40cc922f9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1789043072.370709:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043073.396170:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789043074.354856:0:3311:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789043064/real 1789043064] req@ffffa06a767e8380 x1875947267645568/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789043074 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789043074.354887:0:3311:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa06a767e8380 x1875947267645568/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789043074 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789043074.354906:0:3311:0:(import.c:65:import_set_state_nolock()) ffffa06a7656e800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789043074.354928:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875947267645568:0@lo:39:umount.0 00000100:00080000:1.0:1789043074.355057:0:13384:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789043074.355062:0:13384:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789043074.355066:0:13384:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789043074.355946:0:13384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28000/0x99260d7389c05ed7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c05ede expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043074.355961:0:13384:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28000/0x99260d7389c05ed7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c05ede expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043074.355970:0:13384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28000/0x99260d7389c05ed7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x99260d7389c05ede expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043074.355977:0:13384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28000/0x99260d7389c05ed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x99260d7389c05ede expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043074.356006:0:13384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789043074.356013:0:13384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a413a0a00/0x99260d7389c0610e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06115 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043074.356039:0:13384:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a413a0a00/0x99260d7389c0610e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c06115 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043074.356045:0:13384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a413a0a00/0x99260d7389c0610e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x99260d7389c06115 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043074.356052:0:13384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.117@tcp lock: ffffa06a413a0a00/0x99260d7389c0610e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x99260d7389c06115 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043074.356069:0:13384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789043074.356073:0:13384:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1789043074.356094:0:13384:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1789043074.356098:0:13384:0:(obd_config.c:2575:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1789043074.356102:0:13384:0:(obd_config.c:1570:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789043074.356107:0:13384:0:(obd_config.c:1048:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789043074.356111:0:13384:0:(genops.c:1566:class_disconnect_exports()) OBD device 15 (ffffa06a7732b3b0) has no exports 00000020:00080000:1.0:1789043074.356132:0:13384:0:(genops.c:1566:class_disconnect_exports()) OBD device 15 (ffffa06a7732b3b0) has no exports 00010000:00010000:2.0:1789043074.357854:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789043074.357866:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28000/0x99260d7389c05ed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x99260d7389c05ede expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043074.357877:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc28000 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:2.0:1789043074.357881:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28000/0x99260d7389c05ed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x99260d7389c05ede expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043074.357890:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28000/0x99260d7389c05ed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x99260d7389c05ede expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789043074.357897:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28000/0x99260d7389c05ed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x99260d7389c05ede expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789043074.357903:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789043074.357905:0:5835:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1789043074.357908:0:5835:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1789043074.357925:0:5835:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa06a48454800 00010000:00010000:2.0:1789043074.357929:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28000/0x99260d7389c05ed7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x99260d7389c05ede expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043074.357936:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28000/0x99260d7389c05ed7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x99260d7389c05ede expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043074.357950:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789043074.357954:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a413a0a00/0x99260d7389c0610e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x99260d7389c06115 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043074.357988:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a413a0a00 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:2.0:1789043074.357991:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a413a0a00/0x99260d7389c0610e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x99260d7389c06115 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043074.357998:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a413a0a00/0x99260d7389c0610e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x99260d7389c06115 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789043074.358004:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a413a0a00/0x99260d7389c0610e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x99260d7389c06115 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789043074.358008:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789043074.358010:0:5835:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789043074.358012:0:5835:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789043074.358019:0:5835:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa06a48454800 00010000:00010000:2.0:1789043074.358022:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a413a0a00/0x99260d7389c0610e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x99260d7389c06115 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043074.358027:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a413a0a00/0x99260d7389c0610e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x99260d7389c06115 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043074.358039:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043074.358041:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043074.358043:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043074.358139:0:11175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789043074.359364:0:13384:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffffa06a42fea580 - data ffffa06a7fd7eca8/ffffa06a8173f400 00000020:01000000:1.0:1789043074.362642:0:13384:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffffa06a7725d980 - data ffffa06a70b6a1b0/ffffa06a7654d800 00100000:10000000:1.0:1789043074.375288:0:13384:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789043074.403829:0:13384:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x99260d7389c05dbf 00000020:00000080:3.0:1789043074.403839:0:13384:0:(genops.c:893:class_export_put()) final put ffffa06a77333000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1789043074.405236:0:13384:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa06a7924a000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1789043074.405243:0:13384:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa06a7924a000 2 00000020:01000004:3.0:1789043074.405246:0:13384:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa06a7924a000 from lustre-OST0001 00000020:00000080:3.0:1789043074.405271:0:13384:0:(obd_config.c:1570:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789043074.405281:0:13384:0:(obd_config.c:958:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1789043074.405284:0:13384:0:(genops.c:893:class_export_put()) final put ffffa069412ea800/lustre-OST0001_UUID 00000020:00000080:3.0:1789043074.405287:0:13384:0:(genops.c:852:class_export_destroy()) destroying export ffffa069412ea800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1789043074.405296:0:13384:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1789043074.405415:0:13384:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import 3de3a1ea-f793-48e7-82dd-f3f40cc922f9->MGS 00010000:00010000:3.0:1789043074.405439:0:13384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a429f5c00/0x99260d7389c05cd1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x99260d7389c05cd8 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789043074.405461:0:13384:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a429f5c00/0x99260d7389c05cd1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x99260d7389c05cd8 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789043074.405467:0:13384:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1789043074.405470:0:13384:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1789043074.405473:0:13384:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1789043074.405488:0:13384:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa06a48454800 00010000:00010000:3.0:1789043074.405492:0:13384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a429f5c00/0x99260d7389c05cd1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x99260d7389c05cd8 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043074.405531:0:13384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c05f1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x99260d7389c05f24 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789043074.405538:0:13384:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c05f1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x99260d7389c05f24 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789043074.405543:0:13384:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789043074.405545:0:13384:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1789043074.405547:0:13384:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1789043074.405557:0:13384:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa06a48454800 00010000:00010000:3.0:1789043074.405560:0:13384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c05f1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x99260d7389c05f24 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789043074.405575:0:13384:0:(import.c:65:import_set_state_nolock()) ffffa06a48454800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1789043074.405579:0:13384:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789043074.405582:0:13384:0:(pinger.c:194:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789043074.405583:0:13384:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789043074.405587:0:13384:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789043074.405597:0:13384:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffffa06a7a026a00 x1875947267645312/t0(0) o250->MGC192.168.203.117@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789043076 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789043074.405626:0:13384:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789043074.405628:0:13384:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000020:00000080:1.0:1789043074.405879:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a77333000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:2.0:1789043074.406583:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3de3a1ea-f793-48e7-82dd-f3f40cc922f9:3311:1875947267645312:0@lo:250:kworker.0 10000000:01000000:3.0:1789043074.406748:0:13384:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789043074.406757:0:13384:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x99260d7389c05bb2 00000020:00000080:3.0:1789043074.406763:0:13384:0:(genops.c:893:class_export_put()) final put ffffa06a55f6b800/3de3a1ea-f793-48e7-82dd-f3f40cc922f9 00000020:01000000:3.0:1789043074.406780:0:13384:0:(obd_config.c:2575:class_manual_cleanup()) Manual cleanup of MGC192.168.203.117@tcp (flags='') 00000020:00000080:3.0:1789043074.406785:0:13384:0:(obd_config.c:1570:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789043074.406789:0:13384:0:(obd_config.c:1048:class_cleanup()) MGC192.168.203.117@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789043074.406793:0:13384:0:(genops.c:1566:class_disconnect_exports()) OBD device 2 (ffffa06a5209cd88) has no exports 10000000:01000000:2.0:1789043074.406851:0:5844:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1789043074.406928:0:13384:0:(obd_class.h:676:obd_cleanup_client_import()) MGC192.168.203.117@tcp: client import never connected 00000100:00080000:3.0:1789043074.406932:0:13384:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1789043074.406934:0:13384:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789043074.406937:0:13384:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1789043074.406939:0:13384:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789043074.406968:0:13384:0:(obd_config.c:1570:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789043074.406973:0:13384:0:(obd_config.c:958:class_detach()) detach on obd MGC192.168.203.117@tcp (uuid 3de3a1ea-f793-48e7-82dd-f3f40cc922f9) 00000020:01000000:3.0:1789043074.406988:0:13384:0:(obd_config.c:2575:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789043074.406991:0:13384:0:(obd_config.c:1570:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789043074.406995:0:13384:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789043074.406999:0:13384:0:(genops.c:1827:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffffa06a7656e000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789043074.407004:0:13384:0:(genops.c:1561:class_disconnect_exports()) OBD device 16 (ffffa06a76560000) has exports, disconnecting them 00000020:00080000:3.0:1789043074.407008:0:13384:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffffa06a7656e000), last request at 1789042851 00000020:00000080:3.0:1789043074.407012:0:13384:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x99260d7389c05de9 00000020:00080000:3.0:1789043074.407020:0:13384:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffffa06a7656e000): rc 0 00000020:00000080:3.0:1789043074.407023:0:13384:0:(genops.c:893:class_export_put()) final put ffffa06a7656e000/lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1789043074.407609:0:13384:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1789043074.407613:0:13384:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789043074.407616:0:13384:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789043074.407620:0:13384:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789043074.407738:0:13384:0:(obd_config.c:1570:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789043074.407743:0:13384:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1789043074.407747:0:13384:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa06a7924a000 1 00000020:00000080:3.0:1789043074.407752:0:13384:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x99260d7389c05d8e 00000020:00000080:3.0:1789043074.407756:0:13384:0:(genops.c:893:class_export_put()) final put ffffa06a52b63800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1789043074.407759:0:13384:0:(obd_config.c:2575:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1789043074.407762:0:13384:0:(obd_config.c:1570:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789043074.407765:0:13384:0:(obd_config.c:1048:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789043074.407767:0:13384:0:(genops.c:1566:class_disconnect_exports()) OBD device 14 (ffffa06a52ca0000) has no exports 00000020:00000080:1.0:1789043074.408261:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a55f6b800/3de3a1ea-f793-48e7-82dd-f3f40cc922f9 for MGC192.168.203.117@tcp 00000020:00000080:1.0:1789043074.408272:0:36:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffffa06a48454800 for MGC192.168.203.117@tcp 00000020:00000080:1.0:1789043074.408277:0:36:0:(genops.c:893:class_export_put()) final put ffffa06a48450000/3de3a1ea-f793-48e7-82dd-f3f40cc922f9 00000020:00000080:1.0:1789043074.408279:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a48450000/3de3a1ea-f793-48e7-82dd-f3f40cc922f9 for MGC192.168.203.117@tcp 00000020:01000000:1.0:1789043074.408282:0:36:0:(genops.c:443:class_free_dev()) finishing cleanup of obd MGC192.168.203.117@tcp (3de3a1ea-f793-48e7-82dd-f3f40cc922f9) 00010000:00010000:2.0:1789043074.410924:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1789043074.411042:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1789043074.411090:0:11175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1789043074.411187:0:5830:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffffa06a4679f800:5830] 1 exiting: rc = 0 00000100:00100000:2.0:1789043074.411247:0:5829:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffffa06a4679fa00:5829] 0 exiting: rc = 1 00000100:00100000:2.0:1789043074.411292:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.411492:0:5832:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffffa06a44f85c00:5832] 1 exiting: rc = 0 00000100:00100000:2.0:1789043074.411576:0:5831:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffffa06a4679e000:5831] 0 exiting: rc = 1 00000100:00100000:2.0:1789043074.411633:0:8457:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffffa06a42ff6c00:8457] 4 exiting: rc = 0 00000100:00100000:1.0:1789043074.415069:0:5833:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffffa06a44f85800:5833] 2 exiting: rc = 0 00000020:00000080:2.0:1789043074.426907:0:13384:0:(obd_config.c:1570:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789043074.426921:0:13384:0:(obd_config.c:958:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000100:00100000:2.0:1789043074.427611:0:6705:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffffa06a48241e00:6705] 3 exiting: rc = 0 00000100:00100000:2.0:1789043074.427706:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427712:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427718:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427723:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427728:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427734:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427739:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427743:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427748:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427755:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427760:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427766:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427772:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427778:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427786:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427791:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427798:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427803:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427808:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427812:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427817:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427821:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427825:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427830:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427836:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427840:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427855:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427860:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427865:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427869:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427874:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427879:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427883:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427888:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427893:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427897:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427902:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427907:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427911:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427916:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427921:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427926:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427930:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427935:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427939:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427944:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427948:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427953:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427957:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427963:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427968:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.427973:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.428090:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.428098:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.428104:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.428109:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.428113:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.428118:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.428122:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.428127:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.428131:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.428143:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.428148:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.428153:0:36:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789043074.428883:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a7656e000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1789043074.428892:0:36:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffffa06a7656e800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1789043074.428898:0:36:0:(genops.c:893:class_export_put()) final put ffffa06a6fe4d000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1789043074.428900:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a6fe4d000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1789043074.428904:0:36:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1789043074.428946:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a52b63800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1789043074.428950:0:36:0:(genops.c:893:class_export_put()) final put ffffa06a6fe49800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1789043074.428952:0:36:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a6fe49800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1789043074.428955:0:36:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1789043074.429106:0:13384:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffffa06a6fe4a000 00000020:01000000:2.0:1789043074.429129:0:13384:0:(obd_config.c:2575:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1789043074.429134:0:13384:0:(obd_config.c:1570:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789043074.429138:0:13384:0:(obd_config.c:1048:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789043074.429142:0:13384:0:(genops.c:1566:class_disconnect_exports()) OBD device 10 (ffffa06a52ca33b0) has no exports 00000020:00000080:2.0:1789043074.429161:0:13384:0:(obd_config.c:1570:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789043074.429166:0:13384:0:(obd_config.c:958:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1789043074.429168:0:13384:0:(genops.c:893:class_export_put()) final put ffffa06a45300800/OSS_uuid 00000020:00000080:2.0:1789043074.429171:0:13384:0:(genops.c:852:class_export_destroy()) destroying export ffffa06a45300800/OSS_uuid for OSS 00000020:01000000:2.0:1789043074.429174:0:13384:0:(genops.c:443:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1789043074.429198:0:5842:0:(pinger.c:603:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1789043074.429855:0:8215:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffffa06a7a93e400:8215] 3 exiting: rc = 0 00000100:00100000:3.0:1789043074.430081:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffffa06a55f9bc00:6692] 2 exiting: rc = 0 00000100:00100000:3.0:1789043074.430143:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffffa06a48266800:6690] 0 exiting: rc = 1 00000100:00100000:3.0:1789043074.430193:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffffa06a48267a00:6691] 1 exiting: rc = 0 00000100:00100000:2.0:1789043074.430398:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430406:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430413:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430423:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430428:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430433:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430439:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430444:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430449:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430464:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430470:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430475:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430480:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430485:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430489:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430494:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430499:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430531:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430538:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430545:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430551:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430555:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430560:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430565:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430570:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430575:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430580:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430585:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430595:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430600:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430605:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430611:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430615:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430621:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430626:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430631:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430636:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430642:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430647:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430652:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430658:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430664:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430669:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430674:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430686:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430690:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430695:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430699:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430703:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430707:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430712:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430716:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430720:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430725:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430729:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430734:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430738:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430743:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430747:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430751:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430756:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430760:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430765:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.430769:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.433109:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffffa06a51813c00:6694] 1 exiting: rc = 0 00000100:00100000:3.0:1789043074.435720:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffffa06a6d30ce00:6693] 0 exiting: rc = 1 00000100:00100000:2.0:1789043074.442926:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.442940:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.442945:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.442951:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.442956:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.442962:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.442967:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.442989:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.442995:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443000:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443004:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443010:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443015:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443025:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443044:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443049:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443054:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443059:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443064:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443070:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443075:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443085:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443090:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443096:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443100:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443105:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443109:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443115:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443121:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443126:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443132:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443137:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443142:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443147:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443152:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443157:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443162:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443167:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443172:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443178:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443183:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443187:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443193:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443197:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443202:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443207:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443213:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443218:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443222:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443236:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443240:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443245:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443249:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443254:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443258:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443263:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443268:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443273:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443281:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443287:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443291:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443296:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443300:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.443306:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789043074.444597:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffffa06a6d30c200:6696] 1 exiting: rc = 0 00000100:00100000:1.0:1789043074.444795:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffffa06a42f38800:6695] 0 exiting: rc = 1 00000100:00100000:0.0:1789043074.447110:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffffa06a6d30c400:6697] 2 exiting: rc = 0 00000100:00100000:2.0:1789043074.447573:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447583:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447599:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447605:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447611:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447618:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447624:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447629:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447636:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447643:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447649:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447655:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447660:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447665:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447671:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447677:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447683:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447688:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447694:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447700:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447717:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447723:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447730:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447737:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447743:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447748:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447774:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447780:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447786:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447791:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447797:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447802:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447807:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447814:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447820:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447826:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447832:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447837:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447843:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447848:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447854:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447860:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447866:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447871:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447876:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447881:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447886:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447891:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447897:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447902:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447907:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447912:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447917:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447923:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447929:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447943:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447961:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447969:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447989:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.447995:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.448000:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.448006:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.448012:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.448017:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789043074.453783:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffffa06a42f39800:6698] 0 exiting: rc = 1 00000100:00100000:0.0:1789043074.454053:0:6699:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffffa06a75eb5200:6699] 1 exiting: rc = 0 00000100:00100000:2.0:1789043074.454488:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454498:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454512:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454533:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454540:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454547:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454554:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454562:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454569:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454578:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454587:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454594:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454600:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454605:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454610:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454615:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454621:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454626:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454631:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454635:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454639:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454644:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454649:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454654:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454659:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454664:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454677:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454682:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454686:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454692:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454698:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454703:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454708:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454714:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454718:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454723:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454728:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454733:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454738:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454744:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454750:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454756:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454761:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454767:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454772:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454779:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454784:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454790:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454795:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454799:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454805:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454810:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454817:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454822:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454828:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454833:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454838:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454844:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454849:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454854:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454859:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454873:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454878:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.454884:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789043074.457732:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffffa06a48240600:6700] 0 exiting: rc = 1 00000100:00100000:0.0:1789043074.458187:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffffa06a48240000:6701] 1 exiting: rc = 0 00000100:00100000:2.0:1789043074.458270:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458278:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458284:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458295:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458334:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458344:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458350:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458356:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458381:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458388:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458394:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458400:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458406:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458411:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458416:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458421:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458427:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458433:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458439:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458445:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458464:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458471:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458477:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458484:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458489:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458495:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458509:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458621:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458628:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458634:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458640:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458645:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458674:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458681:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458686:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458691:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458697:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458703:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458709:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458715:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458720:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458725:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458731:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458736:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458754:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458761:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458767:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458773:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458778:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458784:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458790:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458795:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458801:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458806:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458811:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458816:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458834:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458840:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458846:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458851:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458857:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458863:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458869:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789043074.458875:0:13384:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1789043074.483873:0:13384:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1789043089.536809:0:14005:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg317-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789043098.038434:0:14483:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789043098.038440:0:14483:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1789043098.038592:0:14483:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa06a7f846000 00000020:01000004:2.0:1789043098.038618:0:14483:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1789043098.038626:0:14483:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789043098.038638:0:14483:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-osd (ffffa06a7fae33b0) 00000020:00000080:2.0:1789043098.038651:0:14483:0:(obd_config.c:786:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789043098.079737:0:14483:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789043098.085033:0:14483:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1789043098.086358:0:14483:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789043098.086462:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 579: rc = 0 00100000:10000000:3.0:1789043098.091053:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 579: rc = 0 00100000:10000000:3.0:1789043098.091190:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 579: rc = 0 00100000:10000000:3.0:1789043098.091292:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:3.0:1789043098.091405:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:3.0:1789043098.091502:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:1.0:1789043098.099071:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 581: rc = 0 00100000:10000000:1.0:1789043098.100903:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 321: rc = 0 00100000:10000000:1.0:1789043098.101009:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 321: rc = 0 00100000:10000000:1.0:1789043098.101450:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 721: rc = 0 00100000:10000000:1.0:1789043098.102184:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 721: rc = 0 00100000:10000000:1.0:1789043098.102663:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 721: rc = 0 00100000:10000000:1.0:1789043098.104065:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 721: rc = 0 00100000:10000000:1.0:1789043098.104320:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 721: rc = 0 00100000:10000000:1.0:1789043098.108025:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 721: rc = 0 00100000:10000000:1.0:1789043098.108365:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 721: rc = 0 00100000:10000000:1.0:1789043098.109005:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 721: rc = 0 00100000:10000000:1.0:1789043098.109249:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 721: rc = 0 00100000:10000000:1.0:1789043098.111907:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 721: rc = 0 00100000:10000000:1.0:1789043098.112323:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 721: rc = 0 00100000:10000000:1.0:1789043098.115186:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 721: rc = 0 00100000:10000000:1.0:1789043098.115927:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 470: rc = 0 00100000:10000000:1.0:1789043098.116148:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 470: rc = 0 00100000:10000000:1.0:1789043098.116431:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 470: rc = 0 00100000:10000000:1.0:1789043098.117862:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 470: rc = 0 00100000:10000000:1.0:1789043098.118104:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 470: rc = 0 00100000:10000000:1.0:1789043098.118319:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 470: rc = 0 00100000:10000000:1.0:1789043098.121034:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 470: rc = 0 00100000:10000000:1.0:1789043098.121300:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 470: rc = 0 00100000:10000000:1.0:1789043098.128235:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 470: rc = 0 00100000:10000000:1.0:1789043098.128702:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 470: rc = 0 00100000:10000000:2.0:1789043098.132435:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 470: rc = 0 00100000:10000000:2.0:1789043098.132784:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 470: rc = 0 00100000:10000000:2.0:1789043098.133035:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 470: rc = 0 00100000:10000000:2.0:1789043098.133277:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 470: rc = 0 00100000:10000000:2.0:1789043098.133600:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 470: rc = 0 00100000:10000000:2.0:1789043098.133851:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 470: rc = 0 00100000:10000000:2.0:1789043098.134069:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 470: rc = 0 00100000:10000000:2.0:1789043098.134280:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 470: rc = 0 00100000:10000000:2.0:1789043098.134564:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 470: rc = 0 00100000:10000000:2.0:1789043098.137171:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 470: rc = 0 00100000:10000000:2.0:1789043098.139806:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 470: rc = 0 00100000:10000000:2.0:1789043098.140310:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 470: rc = 0 00100000:10000000:2.0:1789043098.140613:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 470: rc = 0 00100000:10000000:2.0:1789043098.142391:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 470: rc = 0 00100000:10000000:2.0:1789043098.142714:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 470: rc = 0 00100000:10000000:2.0:1789043098.143491:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 470: rc = 0 00100000:10000000:2.0:1789043098.143817:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 470: rc = 0 00100000:10000000:2.0:1789043098.144063:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 470: rc = 0 00100000:10000000:2.0:1789043098.144300:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 470: rc = 0 00100000:10000000:2.0:1789043098.148278:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 470: rc = 0 00100000:10000000:2.0:1789043098.148725:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 470: rc = 0 00100000:10000000:3.0:1789043098.153772:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 470: rc = 0 00100000:10000000:3.0:1789043098.154171:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 332: rc = 0 00100000:10000000:3.0:1789043098.154739:0:14483:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1789043098.154902:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 325: rc = 0 00100000:10000000:3.0:1789043098.155081:0:14483:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1789043098.155150:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 325: rc = 0 00100000:10000000:3.0:1789043098.155327:0:14483:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1789043098.155405:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 325: rc = 0 00100000:10000000:3.0:1789043098.155763:0:14483:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1789043098.155833:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 322: rc = 0 00100000:10000000:3.0:1789043098.156013:0:14483:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1789043098.156080:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 322: rc = 0 00100000:10000000:3.0:1789043098.156256:0:14483:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1789043098.156321:0:14483:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 322: rc = 0 00000020:00000080:3.0:1789043098.161095:0:14483:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789043098.161107:0:14483:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789043098.161118:0:14483:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x99260d7389c06eb3 00000020:01000004:3.0:1789043098.161126:0:14483:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1789043098.161131:0:14483:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789043098.161137:0:14483:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa06a7f846000 from MGS 00000020:01000004:3.0:1789043098.161140:0:14483:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789043098.161151:0:14483:0:(genops.c:415:class_newdev()) Allocate new device MGS (ffffa06a765619d8) 00000020:00000080:3.0:1789043098.161160:0:14483:0:(obd_config.c:786:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789043098.161218:0:14483:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa06a7f846000 from MGS, refs=2 00080000:01000000:3.0:1789043098.161223:0:14483:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789043098.161228:0:14483:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x99260d7389c06ec1 00000100:00100000:3.0:1789043098.161333:0:14483:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789043098.161564:0:14483:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789043098.161570:0:14483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789043098.168896:0:14483:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789043098.168918:0:14483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789043098.171503:0:14483:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789043098.171913:0:14483:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789043098.171920:0:14483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789043098.174351:0:14483:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789043098.174362:0:14483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789043098.175178:0:14483:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1789043098.175188:0:14483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789043098.176057:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043098.176061:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043098.176063:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043098.176295:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043098.176298:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043098.176300:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043098.179222:0:14483:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789043098.191946:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789043098.197947:0:14483:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1789043098.197965:0:14483:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789043098.197968:0:14483:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1789043098.199303:0:14492:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789043098.199435:0:14483:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789043098.200323:0:14483:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789043098.200833:0:14483:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789043098.201145:0:14483:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789043098.201306:0:14483:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789043098.201311:0:14483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789043098.205691:0:14483:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789043098.205703:0:14483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789043098.206785:0:14483:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789043098.206795:0:14483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789043098.207607:0:14483:0:(obd_config.c:900:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789043098.207628:0:14483:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.117@tcp' 00000020:01000004:2.0:1789043098.207631:0:14483:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789043098.207659:0:14483:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.117@tcp (typ=mgc) 00000020:00000080:2.0:1789043098.207671:0:14483:0:(genops.c:415:class_newdev()) Allocate new device MGC192.168.203.117@tcp (ffffa06a7fae4d88) 00000020:00000080:2.0:1789043098.207685:0:14483:0:(obd_config.c:786:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789043098.207757:0:14483:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa06a7f9c2000@MGC192.168.203.117@tcp: add connection 192.168.203.117@tcp at head 00000100:00080000:3.0:1789043098.207867:0:14497:0:(pinger.c:501:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:2.0:1789043098.213773:0:14483:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.117@tcp-0 is initialized 00000040:01000000:2.0:1789043098.213783:0:14483:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.117@tcp ctxt 1 is initialized 10000000:01000000:0.0:1789043098.222561:0:14499:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789043098.226590:0:14483:0:(obd_config.c:900:class_setup()) finished setup of obd MGC192.168.203.117@tcp (uuid ff892c07-94a8-4144-ae30-5a70a83d490b) 00000020:00000080:1.0:1789043098.226618:0:14483:0:(genops.c:1393:class_connect()) connect: client ff892c07-94a8-4144-ae30-5a70a83d490b, cookie 0x99260d7389c06ecf 00000100:00080000:1.0:1789043098.226631:0:14483:0:(import.c:545:import_select_connection()) MGC192.168.203.117@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789043098.226638:0:14483:0:(import.c:665:import_select_connection()) MGC192.168.203.117@tcp: import ffffa06a7f9c2000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:1.0:1789043098.226675:0:14483:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa06a6edbb800 x1875947267645696/t0(0) o250->MGC192.168.203.117@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789043098.226698:0:14483:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import ff892c07-94a8-4144-ae30-5a70a83d490b->MGS 00000020:01000004:1.0:1789043098.226721:0:14483:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000100:00100000:2.0:1789043098.226723:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ff892c07-94a8-4144-ae30-5a70a83d490b:3311:1875947267645696:0@lo:250:mount.lustre.0 00000020:01000004:1.0:1789043098.226726:0:14483:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789043098.226738:0:14483:0:(genops.c:415:class_newdev()) Allocate new device MDS (ffffa06a773299d8) 00000020:00000080:1.0:1789043098.226749:0:14483:0:(obd_config.c:786:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789043098.226787:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043098.226854:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267645696 00000100:00100000:2.0:1789043098.226861:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267645696 00000100:00100000:2.0:1789043098.226889:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789043098.226896:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43884c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3311:x1875947267645696:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1789043098.226916:0:14493:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from ff892c07-94a8-4144-ae30-5a70a83d490b@0@lo t0 exp 0000000000000000 cur 441 last 0 00000020:00000080:2.0:1789043098.226934:0:14493:0:(genops.c:1393:class_connect()) connect: client ff892c07-94a8-4144-ae30-5a70a83d490b, cookie 0x99260d7389c06edd 00000100:00080000:2.0:1789043098.227056:0:14493:0:(import.c:65:import_set_state_nolock()) ffffa06a55cd2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789043098.227103:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43884c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+5:3311:x1875947267645696:12345-0@lo:250:mount.lustre.0 Request processed in 206us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043098.227111:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789043098.227154:0:3311:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.117@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789043098.227161:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.117@tcp: connect to target with instance 0 00000100:00080000:2.0:1789043098.227167:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.117@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789043098.227171:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789043098.227173:0:3311:0:(import.c:65:import_set_state_nolock()) ffffa06a7f9c2000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789043098.227175:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789043098.227184:0:3311:0:(pinger.c:187:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789043098.227188:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ff892c07-94a8-4144-ae30-5a70a83d490b:3311:1875947267645696:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789043098.237114:0:14483:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789043098.237305:0:14483:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789043098.237311:0:14483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789043098.243758:0:14483:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789043098.243773:0:14483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789043098.245748:0:14483:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789043098.245759:0:14483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789043098.246434:0:14483:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789043098.246754:0:14483:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789043098.246759:0:14483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789043098.247194:0:14483:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789043098.247200:0:14483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789043098.295780:0:14483:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789043098.296219:0:14483:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789043098.296226:0:14483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789043098.297405:0:14483:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789043098.297414:0:14483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789043098.298033:0:14483:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789043098.298197:0:14483:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789043098.298202:0:14483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789043098.298885:0:14483:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789043098.298892:0:14483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789043098.299437:0:14483:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789043098.299721:0:14483:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789043098.299727:0:14483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789043098.300306:0:14483:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789043098.300313:0:14483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789043098.301128:0:14483:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789043098.301289:0:14483:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789043098.301294:0:14483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789043098.303939:0:14483:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789043098.303952:0:14483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789043098.336208:0:14483:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789043098.336429:0:14483:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789043098.336436:0:14483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789043098.343079:0:14483:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789043098.343099:0:14483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789043098.349934:0:14483:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789043098.349953:0:14483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789043098.350944:0:14483:0:(obd_config.c:900:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789043098.350966:0:14483:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1789043098.350972:0:14483:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.117@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789043098.351109:0:14483:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.117@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789043098.351142:0:14483:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.117@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1789043098.351146:0:14483:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789043098.351148:0:14483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789043098.351154:0:14483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789043098.351155:0:14483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789043098.351156:0:14483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789043098.351157:0:14483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789043098.351158:0:14483:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789043098.351160:0:14483:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789043098.351162:0:14483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789043098.351163:0:14483:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789043098.351165:0:14483:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1789043098.351167:0:14483:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789043098.351168:0:14483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789043098.351170:0:14483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789043098.351171:0:14483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789043098.351172:0:14483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789043098.351173:0:14483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789043098.351174:0:14483:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789043098.351175:0:14483:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789043098.351176:0:14483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789043098.351177:0:14483:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789043098.351201:0:14483:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789043098.351221:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:14483:1875947267645824:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789043098.351286:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043098.351333:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a467d80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789043098.351459:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267645824 00000100:00100000:2.0:1789043098.351466:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267645824 00000100:00100000:2.0:1789043098.351511:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789043098.351550:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43887c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+5:14483:x1875947267645824:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789043098.351584:0:14496:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789043098.351587:0:14496:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789043098.351589:0:14496:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1789043098.353343:0:14517:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789043098.354131:0:14496:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1789043098.366430:0:14518:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1789043098.366440:0:14518:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1789043098.366442:0:14518:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1789043098.366477:0:14518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1789043098.366799:0:14496:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789043098.366809:0:14496:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789043098.376093:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43887c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+5:14483:x1875947267645824:12345-0@lo:253:mount.lustre.0 Request processed in 24535us (24797us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043098.376113:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789043098.376400:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:14483:1875947267645824:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789043098.376416:0:14483:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789043098.376419:0:14483:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789043098.376421:0:14483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789043098.376422:0:14483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789043098.376424:0:14483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789043098.376425:0:14483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789043098.376426:0:14483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789043098.376427:0:14483:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789043098.376428:0:14483:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789043098.376447:0:14483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789043098.376448:0:14483:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789043098.376478:0:14483:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa06a7f846000 from lustre-MDT0000 10000000:01000000:0.0:1789043098.376507:0:14483:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789043098.376510:0:14483:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789043098.376680:0:14483:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffffa06a7fae4d88 10000000:01000000:0.0:1789043098.376687:0:14483:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789043098.376696:0:14483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffffa06a7fae4d88 from 1 10000000:01000000:0.0:1789043098.376699:0:14483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789043098.376737:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6fa00/0x99260d7389c06ee4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043098.376748:0:14483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6fa00/0x99260d7389c06ee4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043098.377187:0:14483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6fa00/0x99260d7389c06ee4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043098.377213:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:14483:1875947267645952:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789043098.377258:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043098.377299:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a467d8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789043098.377386:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267645952 00000100:00100000:2.0:1789043098.377394:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267645952 00000100:00100000:2.0:1789043098.377438:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789043098.377448:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43886c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+5:14483:x1875947267645952:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789043098.377549:0:14495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043098.377565:0:14495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a50978400/0x99260d7389c06eeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c06ee4 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043098.377590:0:14495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a50978400/0x99260d7389c06eeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c06ee4 expref: 6 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043098.377602:0:14495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a50978400/0x99260d7389c06eeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c06ee4 expref: 6 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043098.377611:0:14495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50978400, rc 0) 00000100:00100000:2.0:1789043098.377651:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43886c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+6:14483:x1875947267645952:12345-0@lo:101:mount.lustre.0 Request processed in 204us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043098.377658:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789043098.377745:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:14483:1875947267645952:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789043098.377759:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6fa00/0x99260d7389c06ee4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06eeb expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043098.377767:0:14483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6fa00/0x99260d7389c06ee4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c06eeb expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043098.378043:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:14483:1875947267646080:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789043098.378073:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043098.378114:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a467d8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789043098.378179:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267646080 00000100:00100000:3.0:1789043098.378184:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267646080 00000100:00100000:3.0:1789043098.378216:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789043098.378224:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43884050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+6:14483:x1875947267646080:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789043098.378457:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43884050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+6:14483:x1875947267646080:12345-0@lo:501:mount.lustre.0 Request processed in 234us (383us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789043098.378474:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789043098.378653:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:14483:1875947267646080:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789043098.378679:0:14483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789043098.378732:0:14483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6fa00/0x99260d7389c06ee4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06eeb expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043098.378742:0:14483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6fa00/0x99260d7389c06ee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06eeb expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789043098.378750:0:14483:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa06a7f846000 10000000:01000000:0.0:1789043098.378755:0:14483:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789043098.378760:0:14483:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffffa06a7f846000 10000000:01000000:0.0:1789043098.378762:0:14483:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789043098.378765:0:14483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffffa06a7f846000 from 1 10000000:01000000:0.0:1789043098.378768:0:14483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789043098.378788:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6f600/0x99260d7389c06ef2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043098.378806:0:14483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6f600/0x99260d7389c06ef2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043098.378816:0:14483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6f600/0x99260d7389c06ef2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043098.378828:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:14483:1875947267646208:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789043098.378853:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043098.378896:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a467d8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789043098.379325:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267646208 00000100:00100000:3.0:1789043098.379331:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267646208 00000100:00100000:3.0:1789043098.379377:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789043098.379385:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43884850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+6:14483:x1875947267646208:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789043098.379394:0:14493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789043098.379409:0:14493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a6fc28600/0x99260d7389c06ef9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c06ef2 expref: -99 pid: 14493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043098.379429:0:14493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a6fc28600/0x99260d7389c06ef9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c06ef2 expref: 7 pid: 14493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043098.379454:0:14493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a6fc28600/0x99260d7389c06ef9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c06ef2 expref: 7 pid: 14493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043098.379473:0:14493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc28600, rc 0) 00000100:00100000:3.0:1789043098.379540:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43884850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+7:14483:x1875947267646208:12345-0@lo:101:mount.lustre.0 Request processed in 155us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043098.379547:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789043098.380122:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:14483:1875947267646208:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789043098.380139:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6f600/0x99260d7389c06ef2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06ef9 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043098.380148:0:14483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6f600/0x99260d7389c06ef2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c06ef9 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789043098.380163:0:14483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789043098.383396:0:14483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6f600/0x99260d7389c06ef2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06ef9 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043098.383415:0:14483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6f600/0x99260d7389c06ef2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06ef9 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789043098.383424:0:14483:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789043098.383438:0:14483:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789043098.383446:0:14483:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffffa06a7f846000 10000000:01000000:1.0:1789043098.383451:0:14483:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789043098.383456:0:14483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789043098.383649:0:14483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789043098.383688:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41687c00/0x99260d7389c06f00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043098.383712:0:14483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a41687c00/0x99260d7389c06f00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043098.383724:0:14483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a41687c00/0x99260d7389c06f00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043098.383749:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edb8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:14483:1875947267646336:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789043098.384050:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043098.384127:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a48252240 going to sleep for 11 seconds 00000100:00100000:2.0:1789043098.384172:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267646336 00000100:00100000:2.0:1789043098.384185:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267646336 00000100:00100000:2.0:1789043098.384271:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789043098.384281:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f908c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+7:14483:x1875947267646336:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789043098.384294:0:14495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043098.384306:0:14495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a50979c00/0x99260d7389c06f07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c06f00 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043098.384328:0:14495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a50979c00/0x99260d7389c06f07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c06f00 expref: 8 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043098.384348:0:14495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a50979c00/0x99260d7389c06f07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c06f00 expref: 8 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043098.384358:0:14495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50979c00, rc 0) 00000100:00100000:2.0:1789043098.384443:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f908c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+8:14483:x1875947267646336:12345-0@lo:101:mount.lustre.0 Request processed in 163us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043098.384450:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789043098.384776:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edb8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:14483:1875947267646336:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789043098.384791:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a41687c00/0x99260d7389c06f00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06f07 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043098.384811:0:14483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a41687c00/0x99260d7389c06f00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c06f07 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043098.384867:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edb8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:14483:1875947267646464:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789043098.385442:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043098.385478:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a48252240 going to sleep for 11 seconds 00000100:00100000:0.0:1789043098.385559:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267646464 00000100:00100000:0.0:1789043098.385565:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267646464 00000100:00100000:0.0:1789043098.385606:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789043098.385631:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f908050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+8:14483:x1875947267646464:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789043098.386312:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f908050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+9:14483:x1875947267646464:12345-0@lo:501:mount.lustre.0 Request processed in 681us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043098.386321:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789043098.386427:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edb8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:14483:1875947267646464:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789043098.386480:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edb8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:14483:1875947267646592:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789043098.386592:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043098.386624:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a48252240 going to sleep for 11 seconds 00000100:00100000:2.0:1789043098.386680:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267646592 00000100:00100000:2.0:1789043098.386685:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267646592 00000100:00100000:2.0:1789043098.386720:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789043098.386735:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f908850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+9:14483:x1875947267646592:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789043098.387300:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f908850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+9:14483:x1875947267646592:12345-0@lo:503:mount.lustre.0 Request processed in 564us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043098.387308:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789043098.387414:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edb8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:14483:1875947267646592:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789043098.388228:0:14519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff892c07-94a8-4144-ae30-5a70a83d490b:14519:1875947267646720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789043098.388285:0:14519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043098.388320:0:14519:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a453843c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789043098.388380:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267646720 00000100:00100000:0.0:1789043098.388387:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267646720 00000100:00100000:0.0:1789043098.388428:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789043098.388437:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f909450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+9:14519:x1875947267646720:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789043098.388751:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f909450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+9:14519:x1875947267646720:12345-0@lo:502:llog_process_th.0 Request processed in 314us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043098.388758:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789043098.389125:0:14519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff892c07-94a8-4144-ae30-5a70a83d490b:14519:1875947267646720:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789043098.389162:0:14519:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789043098.389173:0:14519:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789043098.389176:0:14519:0:(obd_config.c:1661:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789043098.389183:0:14519:0:(obd_config.c:2065:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789043098.389185:0:14519:0:(obd_config.c:1570:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789043098.389200:0:14519:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffffa06a7fae0000) 00000020:00000080:2.0:1789043098.389218:0:14519:0:(obd_config.c:786:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789043098.389224:0:14519:0:(obd_config.c:1570:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789043098.389284:0:14519:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789043098.389291:0:14519:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x99260d7389c06f15 00000020:00000080:2.0:1789043098.389634:0:14519:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789043098.389638:0:14519:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789043098.389642:0:14519:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789043098.389644:0:14519:0:(obd_config.c:1661:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789043098.389646:0:14519:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789043098.389650:0:14519:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789043098.389651:0:14519:0:(obd_config.c:1661:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789043098.389654:0:14519:0:(obd_config.c:1570:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789043098.389661:0:14519:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000 (ffffa06a7fae19d8) 00000020:00000080:2.0:1789043098.389672:0:14519:0:(obd_config.c:786:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789043098.389676:0:14519:0:(obd_config.c:1570:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789043098.389678:0:14519:0:(obd_config.c:1614:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789043098.389681:0:14519:0:(obd_config.c:1247:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789043098.389686:0:14519:0:(obd_config.c:1570:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789043098.389726:0:14519:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa06a7f846000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789043098.389749:0:14519:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDD0000 (ffffa06a42f799d8) 00000020:00000080:2.0:1789043098.389760:0:14519:0:(obd_config.c:786:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789043098.389870:0:14519:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789043098.389877:0:14519:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x99260d7389c06f2a 00000020:00000080:2.0:1789043098.389957:0:14519:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789043098.389963:0:14519:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789043098.389968:0:14519:0:(genops.c:1393:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x99260d7389c06f31 00080000:01000000:2.0:1789043098.389978:0:14519:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789043098.389982:0:14519:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x99260d7389c06f38 00010000:00010000:1.0:1789043098.482452:0:14519:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1789043098.482872:0:14519:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:1.0:1789043098.483054:0:14519:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789043098.484560:0:14519:0:(genops.c:415:class_newdev()) Allocate new device lustre-QMT0000 (ffffa06a7732b3b0) 00000020:00000080:1.0:1789043098.484580:0:14519:0:(obd_config.c:786:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789043098.484660:0:14519:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789043098.484667:0:14519:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x99260d7389c06f46 00000020:00000080:2.0:1789043098.485577:0:14519:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789043098.501822:0:14519:0:(genops.c:1393:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x99260d7389c06f4d 00000020:00000080:1.0:1789043098.502429:0:14519:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789043098.502441:0:14519:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789043098.502447:0:14519:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789043098.502450:0:14519:0:(obd_config.c:1661:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789043098.502454:0:14519:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789043098.502460:0:14519:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789043098.502462:0:14519:0:(obd_config.c:1661:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789043098.502466:0:14519:0:(obd_config.c:1570:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789043098.502502:0:14519:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789043098.502539:0:14519:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789043098.502543:0:14519:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789043098.502545:0:14519:0:(obd_config.c:1661:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789043098.502547:0:14519:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789043098.502549:0:14519:0:(obd_config.c:2000:class_config_llog_handler()) SKIP #10 00000020:01000000:1.0:1789043098.502551:0:14519:0:(obd_config.c:2026:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789043098.502552:0:14519:0:(obd_config.c:2026:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789043098.502554:0:14519:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789043098.502556:0:14519:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789043098.502557:0:14519:0:(obd_config.c:1661:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789043098.502559:0:14519:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789043098.502562:0:14519:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789043098.502565:0:14519:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789043098.502567:0:14519:0:(obd_config.c:1661:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789043098.502569:0:14519:0:(obd_config.c:1570:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789043098.502574:0:14519:0:(obd_config.c:1585:class_process_config()) adding mapping from uuid 192.168.203.117@tcp to nid 0x20000c0a8cb75 (192.168.203.117@tcp) 00000020:01000000:1.0:1789043098.502600:0:14519:0:(obd_config.c:2072:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789043098.502610:0:14519:0:(obd_config.c:1570:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789043098.502623:0:14519:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffffa06a7732cd88) 00000020:00000080:1.0:1789043098.502636:0:14519:0:(obd_config.c:786:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1789043098.502640:0:14519:0:(obd_config.c:1570:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789043098.502700:0:14519:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789043098.502705:0:14519:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789043098.502724:0:14519:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x99260d7389c06f5b 00010000:00080000:1.0:1789043098.502755:0:14519:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa06a55f6e800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.117@tcp at head 00010000:00010000:1.0:1789043098.503015:0:14519:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1789043098.504127:0:14519:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789043098.504185:0:14519:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789043098.505676:0:14519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789043098.505803:0:14519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1789043098.505876:0:14519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1789043098.506508:0:14523:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789043098.506537:0:14523:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789043098.507634:0:14519:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789043098.507649:0:14519:0:(obd_config.c:1570:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789043098.507680:0:14519:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789043098.507701:0:14519:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x99260d7389c06f62 00000100:00080000:1.0:1789043098.507712:0:14519:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789043098.507717:0:14519:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa06a55f6e800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:1.0:1789043098.507751:0:14519:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa06a6edb8700 x1875947267646848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789043098.507775:0:14519:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789043098.507828:0:14519:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789043098.507833:0:14519:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789043098.507834:0:14519:0:(obd_config.c:1661:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789043098.507837:0:14519:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789043098.507840:0:14519:0:(obd_config.c:2000:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1789043098.507841:0:14519:0:(obd_config.c:2026:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789043098.507842:0:14519:0:(obd_config.c:2026:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789043098.507844:0:14519:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789043098.507854:0:14519:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789043098.507855:0:14519:0:(obd_config.c:1661:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789043098.507859:0:14519:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789043098.507863:0:14519:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789043098.507866:0:14519:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789043098.507867:0:14519:0:(obd_config.c:1661:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789043098.507871:0:14519:0:(obd_config.c:1570:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789043098.507875:0:14519:0:(obd_config.c:1585:class_process_config()) adding mapping from uuid 192.168.203.117@tcp to nid 0x20000c0a8cb75 (192.168.203.117@tcp) 00000020:01000000:1.0:1789043098.507899:0:14519:0:(obd_config.c:2072:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789043098.507902:0:14519:0:(obd_config.c:1570:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789043098.507913:0:14519:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffffa06a77328000) 00000020:00000080:1.0:1789043098.507925:0:14519:0:(obd_config.c:786:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1789043098.507930:0:14519:0:(obd_config.c:1570:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789043098.508006:0:14519:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789043098.508013:0:14519:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789043098.508020:0:14519:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x99260d7389c06f70 00010000:00080000:1.0:1789043098.508062:0:14519:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa06a7730f000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.117@tcp at head 00010000:00010000:1.0:1789043098.508239:0:14519:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1789043098.508430:0:14519:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789043098.508451:0:14519:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789043098.508948:0:14519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789043098.509007:0:14519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1789043098.509064:0:14519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:2.0:1789043098.509852:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875947267646848:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789043098.509911:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875947267646848 offset 0 length 520: 4 00000040:00080000:2.0:1789043098.511089:0:14525:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789043098.511094:0:14525:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789043098.512116:0:14519:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789043098.512130:0:14519:0:(obd_config.c:1570:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789043098.512158:0:14519:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789043098.512178:0:14519:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x99260d7389c06f77 00000100:00080000:1.0:1789043098.512188:0:14519:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789043098.512193:0:14519:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa06a7730f000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:1.0:1789043098.512224:0:14519:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa06a6edba300 x1875947267646976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789043098.512265:0:14519:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789043098.512413:0:14519:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789043098.512417:0:14519:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789043098.512419:0:14519:0:(obd_config.c:1661:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789043098.512422:0:14519:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789043098.512427:0:14519:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789043098.512428:0:14519:0:(obd_config.c:1661:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789043098.512431:0:14519:0:(obd_config.c:1570:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789043098.512433:0:14519:0:(obd_config.c:1635:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789043098.512435:0:14519:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789043098.512437:0:14519:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789043098.512439:0:14519:0:(obd_config.c:1661:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789043098.512441:0:14519:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789043098.512443:0:14519:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789043098.512445:0:14519:0:(obd_config.c:1661:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789043098.512447:0:14519:0:(obd_config.c:1570:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789043098.512478:0:14519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edbb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff892c07-94a8-4144-ae30-5a70a83d490b:14519:1875947267647104:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789043098.512580:0:14519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043098.512617:0:14519:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a4612eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789043098.512746:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875947267646976:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789043098.512776:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875947267646976 offset 0 length 520: 4 00000100:00100000:3.0:1789043098.512907:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267647104 00000100:00100000:3.0:1789043098.512915:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267647104 00000100:00100000:3.0:1789043098.512962:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789043098.513061:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f90b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+9:14519:x1875947267647104:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789043098.513388:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f90b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+9:14519:x1875947267647104:12345-0@lo:502:llog_process_th.0 Request processed in 416us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043098.513396:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789043098.513791:0:14519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edbb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff892c07-94a8-4144-ae30-5a70a83d490b:14519:1875947267647104:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789043098.513824:0:14519:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789043098.513830:0:14519:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789043098.513832:0:14519:0:(obd_config.c:1661:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789043098.513837:0:14519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1789043098.514028:0:14483:0:(obd_config.c:2243:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1789043098.514050:0:14483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789043098.514103:0:14483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41687c00/0x99260d7389c06f00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06f07 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043098.514115:0:14483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a41687c00/0x99260d7389c06f00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06f07 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789043098.514123:0:14483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa06a7f846000 from 1 10000000:01000000:0.0:1789043098.514126:0:14483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789043098.514156:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6e000/0x99260d7389c06f7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043098.514164:0:14483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6e000/0x99260d7389c06f7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043098.514173:0:14483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6e000/0x99260d7389c06f7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043098.514201:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:14483:1875947267647232:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789043098.514237:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043098.514270:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a467d8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789043098.514323:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267647232 00000100:00100000:1.0:1789043098.514329:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267647232 00000100:00100000:1.0:1789043098.514397:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789043098.514407:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f909850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+9:14483:x1875947267647232:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789043098.514417:0:14495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043098.514436:0:14495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a41687200/0x99260d7389c06f85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c06f7e expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043098.514458:0:14495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a41687200/0x99260d7389c06f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c06f7e expref: 10 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043098.514469:0:14495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a41687200/0x99260d7389c06f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c06f7e expref: 10 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043098.514476:0:14495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41687200, rc 0) 00000100:00100000:1.0:1789043098.514540:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f909850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+10:14483:x1875947267647232:12345-0@lo:101:mount.lustre.0 Request processed in 135us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043098.514547:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789043098.514690:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:14483:1875947267647232:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789043098.514703:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6e000/0x99260d7389c06f7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06f85 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043098.514724:0:14483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6e000/0x99260d7389c06f7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c06f85 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043098.515282:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a027100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:14483:1875947267647360:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789043098.515323:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043098.515933:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a58592180 going to sleep for 11 seconds 00000100:00100000:0.0:1789043098.516059:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267647360 00000100:00100000:0.0:1789043098.516066:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267647360 00000100:00100000:0.0:1789043098.516096:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789043098.516103:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f908450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+10:14483:x1875947267647360:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789043098.516119:0:14496:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789043098.516124:0:14496:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789043098.516202:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f908450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+10:14483:x1875947267647360:12345-0@lo:256:mount.lustre.0 Request processed in 98us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043098.516209:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789043098.516275:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a027100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:14483:1875947267647360:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789043098.520172:0:14483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789043098.520208:0:14483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6e000/0x99260d7389c06f7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06f85 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043098.520222:0:14483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6e000/0x99260d7389c06f7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06f85 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789043098.520231:0:14483:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa06a7f846000 from 1 10000000:01000000:3.0:1789043098.520234:0:14483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789043098.520281:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a6fc29e00/0x99260d7389c06f8c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043098.520289:0:14483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a6fc29e00/0x99260d7389c06f8c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043098.520302:0:14483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a6fc29e00/0x99260d7389c06f8c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043098.520328:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a027100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:14483:1875947267647488:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789043098.520409:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043098.520439:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a58592180 going to sleep for 11 seconds 00000100:00100000:0.0:1789043098.520561:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267647488 00000100:00100000:0.0:1789043098.520570:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267647488 00000100:00100000:0.0:1789043098.520616:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789043098.520625:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f90a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+10:14483:x1875947267647488:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789043098.520637:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789043098.520652:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a7fa6f800/0x99260d7389c06f93 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c06f8c expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043098.520673:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a7fa6f800/0x99260d7389c06f93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c06f8c expref: 11 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043098.520684:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a7fa6f800/0x99260d7389c06f93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c06f8c expref: 11 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043098.520692:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a7fa6f800, rc 0) 00000100:00100000:0.0:1789043098.520815:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f90a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+11:14483:x1875947267647488:12345-0@lo:101:mount.lustre.0 Request processed in 190us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043098.520821:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789043098.521868:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a027100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:14483:1875947267647488:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789043098.521887:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a6fc29e00/0x99260d7389c06f8c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06f93 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043098.521898:0:14483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a6fc29e00/0x99260d7389c06f8c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c06f93 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043098.522025:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a027100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:14483:1875947267647616:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789043098.522064:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043098.522146:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a58592180 going to sleep for 11 seconds 00000100:00100000:2.0:1789043098.525381:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267647616 00000100:00100000:2.0:1789043098.525395:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267647616 00000100:00100000:3.0:1789043098.526394:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789043098.526407:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f90b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+11:14483:x1875947267647616:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789043098.528196:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f90b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+11:14483:x1875947267647616:12345-0@lo:501:mount.lustre.0 Request processed in 1787us (6126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043098.528208:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789043098.528318:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a027100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:14483:1875947267647616:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789043098.528387:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edbb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:14483:1875947267647744:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789043098.528437:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043098.528474:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a412edb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789043098.531354:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267647744 00000100:00100000:3.0:1789043098.531370:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267647744 00000100:00100000:3.0:1789043098.531470:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789043098.531481:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f90b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+11:14483:x1875947267647744:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789043098.531828:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f90b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+11:14483:x1875947267647744:12345-0@lo:503:mount.lustre.0 Request processed in 348us (3388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043098.531836:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789043098.532006:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edbb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:14483:1875947267647744:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789043098.532591:0:14527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff892c07-94a8-4144-ae30-5a70a83d490b:14527:1875947267647872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789043098.532640:0:14527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043098.532720:0:14527:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a46eaa000 going to sleep for 11 seconds 00000100:00100000:1.0:1789043098.532814:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267647872 00000100:00100000:1.0:1789043098.532820:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267647872 00000100:00100000:1.0:1789043098.532898:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789043098.532907:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f90bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+11:14527:x1875947267647872:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789043098.533187:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f90bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+11:14527:x1875947267647872:12345-0@lo:502:llog_process_th.0 Request processed in 280us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043098.533194:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789043098.537875:0:14527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff892c07-94a8-4144-ae30-5a70a83d490b:14527:1875947267647872:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789043098.537926:0:14527:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789043098.537941:0:14527:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789043098.537943:0:14527:0:(obd_config.c:1661:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789043098.537949:0:14527:0:(obd_config.c:2102:class_config_llog_handler()) cmd ce032, instance name: general-ffffa06a7f846000 00000020:00000080:2.0:1789043098.537952:0:14527:0:(obd_config.c:1570:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789043098.537961:0:14527:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789043098.537964:0:14527:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789043098.537965:0:14527:0:(obd_config.c:1661:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789043098.537967:0:14527:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789043098.537970:0:14527:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789043098.538192:0:14527:0:(obd_config.c:1661:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789043098.538199:0:14527:0:(obd_config.c:2102:class_config_llog_handler()) cmd ce032, instance name: general-ffffa06a7f846000 00000020:00000080:2.0:1789043098.538201:0:14527:0:(obd_config.c:1570:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789043098.538262:0:14527:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789043098.538266:0:14527:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789043098.538267:0:14527:0:(obd_config.c:1661:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789043098.538269:0:14527:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789043098.538272:0:14527:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789043098.538274:0:14527:0:(obd_config.c:1661:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789043098.538277:0:14527:0:(obd_config.c:2102:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa06a7f846000 00000020:00000080:2.0:1789043098.538279:0:14527:0:(obd_config.c:1570:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789043098.538346:0:14527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff892c07-94a8-4144-ae30-5a70a83d490b:14527:1875947267648000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789043098.538419:0:14527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043098.538564:0:14527:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a46eaa000 going to sleep for 11 seconds 00000100:00100000:3.0:1789043098.538669:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267648000 00000100:00100000:3.0:1789043098.538677:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267648000 00000100:00100000:3.0:1789043098.538777:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789043098.538788:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f90ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+11:14527:x1875947267648000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789043098.539034:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f90ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+11:14527:x1875947267648000:12345-0@lo:502:llog_process_th.0 Request processed in 247us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043098.539041:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789043098.539100:0:14527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff892c07-94a8-4144-ae30-5a70a83d490b:14527:1875947267648000:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789043098.539123:0:14527:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789043098.539128:0:14527:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789043098.539130:0:14527:0:(obd_config.c:1661:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789043098.539135:0:14527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789043098.540916:0:14483:0:(obd_config.c:2243:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1789043098.540951:0:14483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789043098.541464:0:14483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a6fc29e00/0x99260d7389c06f8c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06f93 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043098.541478:0:14483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a6fc29e00/0x99260d7389c06f8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06f93 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789043098.541548:0:14483:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789043098.541551:0:14483:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa06a7f846000 10000000:01000000:1.0:1789043098.541554:0:14483:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa06a7f846000 10000000:01000000:1.0:1789043098.541558:0:14483:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789043098.541564:0:14483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa06a7f846000 from 1 10000000:01000000:1.0:1789043098.541567:0:14483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789043098.541599:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41686e00/0x99260d7389c06f9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043098.541607:0:14483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a41686e00/0x99260d7389c06f9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043098.541618:0:14483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a41686e00/0x99260d7389c06f9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043098.541642:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edbb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:14483:1875947267648128:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789043098.541706:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043098.541884:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a48252240 going to sleep for 11 seconds 00000100:00100000:2.0:1789043098.543838:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267648128 00000100:00100000:2.0:1789043098.543850:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267648128 00000100:00100000:2.0:1789043098.543901:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789043098.543910:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+11:14483:x1875947267648128:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789043098.543926:0:14493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043098.543942:0:14493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a50979400/0x99260d7389c06fa1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c06f9a expref: -99 pid: 14493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043098.543968:0:14493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a50979400/0x99260d7389c06fa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c06f9a expref: 12 pid: 14493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043098.543979:0:14493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a50979400/0x99260d7389c06fa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c06f9a expref: 12 pid: 14493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043098.543988:0:14493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50979400, rc 0) 00000100:00100000:2.0:1789043098.544059:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+12:14483:x1875947267648128:12345-0@lo:101:mount.lustre.0 Request processed in 149us (2352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043098.544074:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789043098.544645:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edbb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:14483:1875947267648128:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789043098.544664:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a41686e00/0x99260d7389c06f9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06fa1 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043098.544674:0:14483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a41686e00/0x99260d7389c06f9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c06fa1 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043098.546017:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edbb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:14483:1875947267648256:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789043098.546074:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043098.546111:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a48252240 going to sleep for 11 seconds 00000100:00100000:2.0:1789043098.546591:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267648256 00000100:00100000:2.0:1789043098.546599:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267648256 00000100:00100000:2.0:1789043098.546643:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789043098.546652:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+12:14483:x1875947267648256:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789043098.546913:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+12:14483:x1875947267648256:12345-0@lo:501:mount.lustre.0 Request processed in 261us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043098.546920:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789043098.550874:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edbb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:14483:1875947267648256:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789043098.550935:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edbb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:14483:1875947267648384:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789043098.551007:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043098.551047:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a48252240 going to sleep for 11 seconds 00000100:00100000:3.0:1789043098.551602:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267648384 00000100:00100000:3.0:1789043098.551611:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267648384 00000100:00100000:3.0:1789043098.551667:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789043098.551677:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+12:14483:x1875947267648384:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789043098.551888:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+12:14483:x1875947267648384:12345-0@lo:503:mount.lustre.0 Request processed in 211us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043098.551895:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789043098.552064:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edbb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:14483:1875947267648384:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789043098.561805:0:14531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a025500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff892c07-94a8-4144-ae30-5a70a83d490b:14531:1875947267648512:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789043098.561891:0:14531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043098.561933:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267648512 00000100:00100000:3.0:1789043098.561941:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267648512 00000100:00100000:3.0:1789043098.561978:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789043098.561987:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79efe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+12:14531:x1875947267648512:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789043098.562214:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79efe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+12:14531:x1875947267648512:12345-0@lo:502:llog_process_th.0 Request processed in 227us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043098.562221:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789043098.562269:0:14531:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a41254180 going to sleep for 11 seconds 00000100:00100000:3.0:1789043098.562289:0:14531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a025500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff892c07-94a8-4144-ae30-5a70a83d490b:14531:1875947267648512:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1789043098.562358:0:14531:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789043098.562372:0:14531:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffffa06a765633b0) 00000020:00000080:3.0:1789043098.562390:0:14531:0:(obd_config.c:786:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1789043098.562465:0:14531:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa06a7f846000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789043098.562469:0:14531:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa06a7f846000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789043098.562471:0:14531:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa06a7f846000 4 00010000:00080000:3.0:1789043098.562497:0:14531:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa06a7b797000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.117@tcp at head 00010000:00010000:3.0:1789043098.567624:0:14531:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1789043098.567886:0:14531:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789043098.567928:0:14531:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789043098.567940:0:14531:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x99260d7389c06faf 00000100:00080000:3.0:1789043098.567952:0:14531:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789043098.567958:0:14531:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffffa06a7b797000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:3.0:1789043098.567992:0:14531:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa06a7a025500 x1875947267648640/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789043098.568017:0:14531:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789043098.569855:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875947267648640:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789043098.569927:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043098.570660:0:14531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff892c07-94a8-4144-ae30-5a70a83d490b:14531:1875947267648768:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789043098.570721:0:14531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043098.570740:0:14531:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a46eaa840 going to sleep for 11 seconds 00000100:00100000:1.0:1789043098.571001:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267648640 00000100:00100000:1.0:1789043098.571009:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267648640 00000100:00100000:1.0:1789043098.571047:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789043098.571054:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1875947267648640:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789043098.571327:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1875947267648640:12345-0@lo:38:llog_process_th.0 Request processed in 270us (1398us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789043098.571344:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789043098.571501:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789043098.571509:0:3311:0:(import.c:65:import_set_state_nolock()) ffffa06a7b797000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789043098.571584:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789043098.571588:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875947267648640:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789043098.572193:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267648768 00000100:00100000:0.0:1789043098.572200:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267648768 00000100:00100000:0.0:1789043098.572241:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789043098.572250:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79efd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+12:14531:x1875947267648768:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789043098.572501:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79efd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+12:14531:x1875947267648768:12345-0@lo:502:llog_process_th.0 Request processed in 252us (1789us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043098.572509:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789043098.573400:0:14531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff892c07-94a8-4144-ae30-5a70a83d490b:14531:1875947267648768:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789043098.573436:0:14531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789043098.573832:0:14483:0:(obd_config.c:2243:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789043098.573854:0:14483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789043098.573913:0:14483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41686e00/0x99260d7389c06f9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06fa1 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043098.573925:0:14483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a41686e00/0x99260d7389c06f9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06fa1 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789043098.573973:0:14483:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789043098.573975:0:14483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789043098.573980:0:14483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789043098.573982:0:14483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789043098.573983:0:14483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789043098.573984:0:14483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789043098.573985:0:14483:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789043098.573987:0:14483:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789043098.573989:0:14483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789043098.573990:0:14483:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789043098.573993:0:14483:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1789043098.573996:0:14483:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789043098.573997:0:14483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789043098.573998:0:14483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789043098.573998:0:14483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789043098.573999:0:14483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789043098.574000:0:14483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789043098.574001:0:14483:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789043098.574002:0:14483:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789043098.574003:0:14483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789043098.574004:0:14483:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789043098.574025:0:14483:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789043098.574042:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edbb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:14483:1875947267648896:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789043098.574088:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043098.574125:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7f8ce600 going to sleep for 11 seconds 00000100:00100000:3.0:1789043098.577393:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267648896 00000100:00100000:3.0:1789043098.577406:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267648896 00000100:00100000:3.0:1789043098.577456:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789043098.577466:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79efc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+12:14483:x1875947267648896:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789043098.577498:0:14496:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789043098.577510:0:14496:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789043098.616030:0:14496:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789043098.616047:0:14496:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789043098.616068:0:14517:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789043098.616073:0:14517:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789043098.616096:0:14517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa06a50979600/0x99260d7389c06fb6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043098.616136:0:14517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a41687200/0x99260d7389c06f85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c06f7e expref: 12 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043098.616145:0:14517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa06a50979600/0x99260d7389c06fb6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043098.616186:0:14517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a41687200/0x99260d7389c06f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99260d7389c06f7e expref: 12 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043098.616200:0:14517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa06a41687200/0x99260d7389c06f85 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99260d7389c06f7e expref: 12 pid: 14495 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043098.616214:0:14517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c5f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14517:1875947267649024:0@lo:104: 00000100:00100000:2.0:1789043098.616275:0:14517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043098.616314:0:14517:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a46eaa000 going to sleep for 11 seconds 00000100:00100000:2.0:1789043098.616364:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267649024 00000100:00100000:2.0:1789043098.616373:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267649024 00000100:00100000:2.0:1789043098.616416:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789043098.616425:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff892c07-94a8-4144-ae30-5a70a83d490b+3:14517:x1875947267649024:12345-0@lo:104: 00010000:00010000:2.0:1789043098.616437:0:14484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6e000/0x99260d7389c06f7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c06f85 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043098.616485:0:14484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789043098.616490:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff892c07-94a8-4144-ae30-5a70a83d490b+3:14517:x1875947267649024:12345-0@lo:104: Request processed in 67us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043098.616496:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789043098.616541:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789043098.616547:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6e000/0x99260d7389c06f7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c06f85 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043098.616560:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a7fa6e000 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:2.0:1789043098.616564:0:14490:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6e000/0x99260d7389c06f7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x99260d7389c06f85 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043098.616573:0:14490:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6e000/0x99260d7389c06f7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x99260d7389c06f85 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789043098.616580:0:14490:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6e000/0x99260d7389c06f7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x99260d7389c06f85 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789043098.616586:0:14490:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789043098.616613:0:14490:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6e000/0x99260d7389c06f7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c06f85 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043098.616618:0:14490:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789043098.616638:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6e000/0x99260d7389c06f7e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c06f85 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043098.616644:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6e000/0x99260d7389c06f7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c06f85 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043098.616660:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043098.616661:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043098.616663:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789043098.616685:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff892c07-94a8-4144-ae30-5a70a83d490b:3313:1875947267649152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789043098.616711:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043098.616781:0:14517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c5f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14517:1875947267649024:0@lo:104: 00010000:00010000:2.0:1789043098.616799:0:14517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa06a50979600/0x99260d7389c06fb6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043098.617006:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267649152 00000100:00100000:1.0:1789043098.617012:0:14486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267649152 00010000:00010000:1.0:1789043098.617035:0:14486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a41687200/0x99260d7389c06f85 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c06f7e expref: 13 pid: 14495 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043098.617057:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789043098.617065:0:14486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ff892c07-94a8-4144-ae30-5a70a83d490b+13:3313:x1875947267649152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789043098.617075:0:14486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789043098.617080:0:14486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a41687200/0x99260d7389c06f85 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c06f7e expref: 13 pid: 14495 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043098.617091:0:14486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a41687200/0x99260d7389c06f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99260d7389c06f7e expref: 13 pid: 14495 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043098.617111:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a41687200/0x99260d7389c06f85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99260d7389c06f7e expref: 13 pid: 14495 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043098.617123:0:14486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa06a50979600/0x99260d7389c06fb6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043098.617132:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a50979600/0x99260d7389c06fb6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789043098.617145:0:14486:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001072641s 00010000:00010000:1.0:1789043098.617150:0:14486:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa06a50979600/0x99260d7389c06fb6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043098.617157:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa06a50979600/0x99260d7389c06fb6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043098.617164:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa06a50979600/0x99260d7389c06fb6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043098.617170:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa06a50979600/0x99260d7389c06fb6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043098.617175:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979600 already unused, calling callback (ffffffffc1470760) 00010000:00010000:1.0:1789043098.617179:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa06a50979600/0x99260d7389c06fb6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043098.617185:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa06a50979600/0x99260d7389c06fb6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043098.617193:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa06a50979600/0x99260d7389c06fb6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043098.617210:0:14486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789043098.617243:0:14486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ff892c07-94a8-4144-ae30-5a70a83d490b+12:3313:x1875947267649152:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043098.617250:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789043098.617371:0:14517:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa06a50979600/0x99260d7389c06fb6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043098.617379:0:14517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa06a50979600/0x99260d7389c06fb6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043098.617385:0:14517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a50979600/0x99260d7389c06fb6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043098.617410:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff892c07-94a8-4144-ae30-5a70a83d490b:3313:1875947267649152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789043098.631103:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79efc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+11:14483:x1875947267648896:12345-0@lo:253:mount.lustre.0 Request processed in 53628us (57004us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043098.631118:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789043098.631205:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edbb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:14483:1875947267648896:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789043098.631221:0:14483:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789043098.631224:0:14483:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789043098.631225:0:14483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789043098.631227:0:14483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789043098.631228:0:14483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789043098.631229:0:14483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789043098.631230:0:14483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789043098.631232:0:14483:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789043098.631233:0:14483:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789043098.631235:0:14483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789043098.631237:0:14483:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789043098.631250:0:14483:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789043098.639053:0:14483:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1789043098.639226:0:14483:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789043098.639549:0:14483:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1789043098.640098:0:14483:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789043098.640404:0:14483:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789043098.640599:0:14483:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1789043098.641960:0:14483:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1789043098.642140:0:14483:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1789043098.642434:0:14483:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1789043098.642888:0:14483:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1789043098.643165:0:14483:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1789043098.643331:0:14483:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1789043098.666172:0:14483:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1789043098.666667:0:14483:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1789043098.666916:0:14538:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1789043098.666920:0:14538:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1789043098.667092:0:14539:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1789043098.667162:0:14539:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1789043098.670417:0:14483:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789043098.670584:0:14483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789043098.672423:0:14483:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789043098.672439:0:14483:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789043098.673006:0:14539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789043098.673077:0:14539:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789043098.673082:0:14539:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:0.0:1789043098.673366:0:14483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789043098.675993:0:14483:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789043098.676787:0:14483:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789043098.676899:0:14483:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1789043098.678631:0:14483:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1789043098.684281:0:14483:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1789043098.734365:0:14483:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789043098.734400:0:14483:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffafe140d87988 00100000:10000000:1.0:1789043098.734477:0:14483:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789043098.735562:0:14483:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789043098.735579:0:14483:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.117@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789043098.735614:0:14483:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1789043098.735632:0:14483:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1789043099.251630:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789043099.378795:0:14499:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789043099.378803:0:14499:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa06a7f846000 from 6 10000000:01000000:2.0:1789043099.378808:0:14499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789043099.378851:0:14499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a50978600/0x99260d7389c06fbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043099.378863:0:14499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a50978600/0x99260d7389c06fbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043099.378874:0:14499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a50978600/0x99260d7389c06fbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043099.378900:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff892c07-94a8-4144-ae30-5a70a83d490b:14499:1875947267649280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789043099.378975:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043099.379463:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a52c309c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789043099.381087:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267649280 00000100:00100000:3.0:1789043099.381099:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267649280 00000100:00100000:3.0:1789043099.381154:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789043099.381164:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+11:14499:x1875947267649280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789043099.381179:0:14493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789043099.381198:0:14493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a6fc29000/0x99260d7389c06fc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c06fbd expref: -99 pid: 14493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043099.381242:0:14493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a6fc29000/0x99260d7389c06fc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c06fbd expref: 12 pid: 14493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043099.381253:0:14493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a6fc29000/0x99260d7389c06fc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c06fbd expref: 12 pid: 14493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043099.381263:0:14493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc29000, rc 0) 00000100:00100000:3.0:1789043099.381340:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+12:14499:x1875947267649280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (2356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043099.381347:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789043099.381504:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff892c07-94a8-4144-ae30-5a70a83d490b:14499:1875947267649280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789043099.381547:0:14499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a50978600/0x99260d7389c06fbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06fc4 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043099.381558:0:14499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a50978600/0x99260d7389c06fbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c06fc4 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043099.381617:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff892c07-94a8-4144-ae30-5a70a83d490b:14499:1875947267649408:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789043099.381651:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043099.381694:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a52c309c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789043099.381801:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267649408 00000100:00100000:1.0:1789043099.381813:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267649408 00000100:00100000:1.0:1789043099.381851:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789043099.381859:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+12:14499:x1875947267649408:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789043099.381872:0:14496:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789043099.381885:0:14496:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789043099.381889:0:14496:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1789043099.382014:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+12:14499:x1875947267649408:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 156us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043099.382022:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789043099.382317:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff892c07-94a8-4144-ae30-5a70a83d490b:14499:1875947267649408:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789043099.382391:0:14499:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789043099.382399:0:14499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a50978600/0x99260d7389c06fbd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06fc4 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043099.382408:0:14499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a50978600/0x99260d7389c06fbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06fc4 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789043099.571463:0:14533:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789043100.275638:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789043100.595198:0:14533:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789043101.302213:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043102.322774:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043103.357489:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789043103.365328:0:14782:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1789043103.989073:0:470:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789043103.989080:0:470:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789043103.989083:0:470:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789043103.989085:0:470:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789043103.989088:0:470:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789043103.989099:0:470:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789043103.989102:0:470:0:(import.c:65:import_set_state_nolock()) ffffa06a7b797000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789043103.989113:0:470:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffffa06a7b797000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:2.0:1789043103.989137:0:470:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa06a7f8c5f80 x1875947267649664/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789043103.989200:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875947267649664:0@lo:38:kworker.0 00000100:00100000:2.0:1789043103.989263:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043103.989383:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267649664 00000100:00100000:2.0:1789043103.989391:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267649664 00000100:00100000:2.0:1789043103.989427:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789043103.989434:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3311:x1875947267649664:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789043103.989458:0:14503:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:2.0:1789043103.989495:0:14503:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x99260d7389c06fcb 00000004:00100000:2.0:1789043103.989509:0:14503:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789043103.989705:0:14503:0:(import.c:65:import_set_state_nolock()) ffffa06a45306000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789043103.989757:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875947267649664:12345-0@lo:38:kworker.0 Request processed in 321us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043103.989765:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789043103.989804:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa06a7f8c5f80 x1875947267649664/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789043113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789043103.989818:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789043103.989825:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789043103.989829:0:3311:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789043103.989831:0:3311:0:(import.c:65:import_set_state_nolock()) ffffa06a7b797000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789043103.989837:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875947267649664:0@lo:38:kworker.0 00000100:00100000:0.0:1789043103.990422:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff892c07-94a8-4144-ae30-5a70a83d490b:3314:1875947267649536:0@lo:400:kworker.0 00000100:00100000:0.0:1789043103.990461:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043103.990570:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267649536 00000100:00100000:0.0:1789043103.990575:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267649536 00000100:00100000:0.0:1789043103.990607:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789043103.990615:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+12:3314:x1875947267649536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789043103.990652:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+12:3314:x1875947267649536:12345-0@lo:400:kworker.0 Request processed in 38us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043103.990658:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789043103.990934:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff892c07-94a8-4144-ae30-5a70a83d490b:3314:1875947267649536:0@lo:400:kworker.0 00010000:00010000:2.0:1789043104.371710:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043105.394883:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043106.420455:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789043106.501939:0:14934:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff09df3a50 20000000:00000080:0.0:1789043106.501957:0:14934:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa06a7aefbc00 uarg=0000000000000000 20000000:01000000:0.0:1789043106.501992:0:14934:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1789043106.501999:0:14934:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1789043106.502004:0:14934:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789043106.507325:0:14935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1789043106.511499:0:14934:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789043106.524322:0:14934:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789043106.527272:0:14934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa06a50979600/0x99260d7389c06fd2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043106.527308:0:14934:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a7fa6f800/0x99260d7389c06f93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c06f8c expref: 11 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043106.527317:0:14934:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa06a50979600/0x99260d7389c06fd2 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043106.527376:0:14934:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a7fa6f800/0x99260d7389c06f93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99260d7389c06f8c expref: 11 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043106.527394:0:14934:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa06a7fa6f800/0x99260d7389c06f93 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99260d7389c06f8c expref: 11 pid: 14496 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043106.527407:0:14934:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14934:1875947267649792:0@lo:104: 00000100:00100000:2.0:1789043106.527473:0:14934:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043106.527773:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267649792 00000100:00100000:0.0:1789043106.527782:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267649792 00000100:00100000:0.0:1789043106.527872:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789043106.527882:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff892c07-94a8-4144-ae30-5a70a83d490b+3:14934:x1875947267649792:12345-0@lo:104: 00010000:00010000:0.0:1789043106.527894:0:14485:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffffa06a6fc29e00/0x99260d7389c06f8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c06f93 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043106.527960:0:14485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789043106.527966:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff892c07-94a8-4144-ae30-5a70a83d490b+3:14934:x1875947267649792:12345-0@lo:104: Request processed in 86us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043106.527990:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1789043106.528012:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789043106.528018:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a6fc29e00/0x99260d7389c06f8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c06f93 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043106.528026:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc29e00 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:0.0:1789043106.528030:0:14489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a6fc29e00/0x99260d7389c06f8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x99260d7389c06f93 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043106.528040:0:14489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a6fc29e00/0x99260d7389c06f8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x99260d7389c06f93 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789043106.528047:0:14489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a6fc29e00/0x99260d7389c06f8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x99260d7389c06f93 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789043106.528053:0:14489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789043106.528082:0:14489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a6fc29e00/0x99260d7389c06f8c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c06f93 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043106.528088:0:14489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789043106.528108:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a6fc29e00/0x99260d7389c06f8c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c06f93 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043106.528115:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a6fc29e00/0x99260d7389c06f8c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c06f93 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043106.528132:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043106.528134:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043106.528135:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789043106.528154:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ff892c07-94a8-4144-ae30-5a70a83d490b:3315:1875947267649920:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789043106.528190:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043106.528222:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267649920 00000100:00100000:0.0:1789043106.528226:0:14486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267649920 00010000:00010000:0.0:1789043106.528243:0:14486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a7fa6f800/0x99260d7389c06f93 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c06f8c expref: 12 pid: 14496 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043106.528265:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789043106.528271:0:14486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ff892c07-94a8-4144-ae30-5a70a83d490b+12:3315:x1875947267649920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789043106.528292:0:14486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789043106.528297:0:14486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a7fa6f800/0x99260d7389c06f93 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c06f8c expref: 12 pid: 14496 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043106.528306:0:14486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a7fa6f800/0x99260d7389c06f93 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99260d7389c06f8c expref: 12 pid: 14496 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043106.528320:0:14486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa06a50979600/0x99260d7389c06fd2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043106.528328:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a50979600/0x99260d7389c06fd2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043106.528341:0:14486:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa06a50979600/0x99260d7389c06fd2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043106.528348:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa06a50979600/0x99260d7389c06fd2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043106.528424:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa06a50979600/0x99260d7389c06fd2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043106.528431:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa06a50979600/0x99260d7389c06fd2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043106.528443:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979600 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789043106.528448:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa06a50979600/0x99260d7389c06fd2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043106.528456:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa06a50979600/0x99260d7389c06fd2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043106.528465:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa06a50979600/0x99260d7389c06fd2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043106.528475:0:14486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789043106.528505:0:14486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ff892c07-94a8-4144-ae30-5a70a83d490b+12:3315:x1875947267649920:12345-0@lo:103:ldlm_bl.0 Request processed in 234us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043106.528532:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789043106.528957:0:14934:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a44cc1f00 going to sleep for 11 seconds 00010000:00010000:2.0:1789043106.528982:0:14934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a7fa6f800/0x99260d7389c06f93 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99260d7389c06f8c expref: 11 pid: 14496 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043106.528993:0:14934:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14934:1875947267649792:0@lo:104: 00010000:00010000:2.0:1789043106.529011:0:14934:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa06a50979600/0x99260d7389c06fd2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043106.529019:0:14934:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa06a50979600/0x99260d7389c06fd2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043106.529025:0:14934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa06a50979600/0x99260d7389c06fd2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043106.529040:0:14934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a50979600/0x99260d7389c06fd2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043106.530037:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ff892c07-94a8-4144-ae30-5a70a83d490b:3315:1875947267649920:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789043107.442695:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789043108.083617:0:3311:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789043098/real 1789043098] req@ffffa06a6edba300 x1875947267646976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789043108 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789043108.083652:0:3311:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa06a6edba300 x1875947267646976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789043108 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789043108.083663:0:3311:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789043098/real 1789043098] req@ffffa06a6edb8700 x1875947267646848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789043108 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789043108.083674:0:3311:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa06a6edb8700 x1875947267646848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789043108 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789043108.083693:0:3311:0:(import.c:65:import_set_state_nolock()) ffffa06a7730f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789043108.083715:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789043108.083720:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875947267646976:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789043108.083726:0:3311:0:(import.c:65:import_set_state_nolock()) ffffa06a55f6e800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789043108.083731:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789043108.083734:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875947267646848:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789043108.089379:0:470:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789043108.089386:0:470:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00100000:2.0:1789043108.089387:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:1.0:1789043108.089389:0:470:0:(import.c:65:import_set_state_nolock()) ffffa06a55f6e800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789043108.089397:0:470:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 441 00000100:00080000:1.0:1789043108.089402:0:470:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00100000:2.0:1789043108.089404:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff892c07-94a8-4144-ae30-5a70a83d490b:3313:1875947267650048:0@lo:400:kworker.0 00000100:00080000:1.0:1789043108.089409:0:470:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa06a55f6e800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:1.0:1789043108.089429:0:470:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa06a6edb8380 x1875947267650176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789043108.089444:0:470:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789043108.089446:0:470:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789043108.089448:0:470:0:(import.c:65:import_set_state_nolock()) ffffa06a7730f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789043108.089468:0:470:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 441 00000100:00080000:1.0:1789043108.089471:0:470:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789043108.089476:0:470:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa06a7730f000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:2.0:1789043108.089480:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043108.089487:0:470:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa06a6edb9f80 x1875947267650304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789043108.089549:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875947267650432:0@lo:400:kworker.0 00000100:00100000:1.0:1789043108.089555:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875947267650176:0@lo:8:kworker.0 00000100:00100000:2.0:1789043108.089576:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000400:00000100:1.0:1789043108.089580:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875947267650176 offset 0 length 520: 4 00000100:00100000:1.0:1789043108.089599:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875947267650304:0@lo:8:kworker.0 00000100:00100000:2.0:1789043108.089615:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267650048 00000400:00000100:1.0:1789043108.089616:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875947267650304 offset 0 length 520: 4 00000100:00100000:2.0:1789043108.089622:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267650048 00000100:00100000:1.0:1789043108.089648:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267650432 00000100:00100000:1.0:1789043108.089652:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267650432 00000100:00100000:2.0:1789043108.089664:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789043108.089671:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+11:3313:x1875947267650048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789043108.089675:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789043108.089680:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875947267650432:12345-0@lo:400:kworker.0 10000000:01000000:0.0:1789043108.090336:0:14499:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789043108.090341:0:14499:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa06a7f846000 from 10 10000000:01000000:0.0:1789043108.090346:0:14499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789043108.090376:0:14499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6f000/0x99260d7389c06fd9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043108.090388:0:14499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6f000/0x99260d7389c06fd9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043108.090400:0:14499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6f000/0x99260d7389c06fd9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043108.090417:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff892c07-94a8-4144-ae30-5a70a83d490b:14499:1875947267650560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789043108.090460:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043108.090478:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a46f1f600 going to sleep for 11 seconds 00000100:00100000:0.0:1789043108.090492:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267650560 00000100:00100000:0.0:1789043108.090496:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267650560 00000100:00100000:0.0:1789043108.090534:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789043108.090542:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+12:14499:x1875947267650560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789043108.090551:0:14493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789043108.090565:0:14493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a7fa6f800/0x99260d7389c06fe0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c06fd9 expref: -99 pid: 14493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043108.090586:0:14493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a7fa6f800/0x99260d7389c06fe0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c06fd9 expref: 13 pid: 14493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043108.090597:0:14493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a7fa6f800/0x99260d7389c06fe0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c06fd9 expref: 13 pid: 14493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043108.090606:0:14493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a7fa6f800, rc 0) 00000100:00100000:0.0:1789043108.090635:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+13:14499:x1875947267650560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043108.090642:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789043108.090682:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff892c07-94a8-4144-ae30-5a70a83d490b:14499:1875947267650560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789043108.090695:0:14499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6f000/0x99260d7389c06fd9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06fe0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043108.090704:0:14499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6f000/0x99260d7389c06fd9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c06fe0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043108.090749:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff892c07-94a8-4144-ae30-5a70a83d490b:14499:1875947267650688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789043108.090778:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043108.090790:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a46f1f600 going to sleep for 11 seconds 00000100:00100000:0.0:1789043108.090800:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267650688 00000100:00100000:0.0:1789043108.090803:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267650688 00000100:00100000:0.0:1789043108.090821:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789043108.090827:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+13:14499:x1875947267650688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789043108.091018:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+13:14499:x1875947267650688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 191us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043108.091025:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789043108.091052:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff892c07-94a8-4144-ae30-5a70a83d490b:14499:1875947267650688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789043108.091075:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff892c07-94a8-4144-ae30-5a70a83d490b:14499:1875947267650816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789043108.091112:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043108.091125:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a46f1f600 going to sleep for 11 seconds 00000100:00100000:0.0:1789043108.091135:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267650816 00000100:00100000:0.0:1789043108.091138:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267650816 00000100:00100000:0.0:1789043108.091156:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789043108.091162:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+13:14499:x1875947267650816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789043108.091319:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+13:14499:x1875947267650816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043108.091326:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789043108.091362:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff892c07-94a8-4144-ae30-5a70a83d490b:14499:1875947267650816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789043108.092056:0:14995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789043108.092114:0:14499:0:(obd_config.c:2243:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789043108.092127:0:14499:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789043108.092136:0:14499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6f000/0x99260d7389c06fd9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06fe0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043108.092155:0:14499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6f000/0x99260d7389c06fd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06fe0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043108.093562:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875947267650432:12345-0@lo:400:kworker.0 Request processed in 31us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043108.093577:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789043108.094183:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+12:3313:x1875947267650048:12345-0@lo:400:kworker.0 Request processed in 4508us (4699us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043108.094192:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1789043108.100235:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa06a6edb9880 x1875947267650432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789043124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789043108.100255:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875947267650432:0@lo:400:kworker.0 00000100:00100000:3.0:1789043108.100289:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff892c07-94a8-4144-ae30-5a70a83d490b:3313:1875947267650048:0@lo:400:kworker.0 00010000:00010000:0.0:1789043108.466677:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043109.490903:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043110.521764:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789043110.836202:0:14533:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789043111.539823:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789043111.691391:0:15183:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789043111.691397:0:15183:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1789043111.691726:0:15183:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa06a763bb000 00000020:01000004:0.0:1789043111.691746:0:15183:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789043111.691763:0:15183:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789043111.691780:0:15183:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0000-osd (ffffa06a473419d8) 00000020:00000080:0.0:1789043111.691802:0:15183:0:(obd_config.c:786:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789043111.714747:0:15183:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789043111.715183:0:15183:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789043111.719498:0:15183:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789043111.720062:0:15183:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789043111.723756:0:15183:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789043111.724391:0:15183:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 573: rc = 0 00100000:10000000:2.0:1789043111.727282:0:15183:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 573: rc = 0 00100000:10000000:2.0:1789043111.728625:0:15183:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 573: rc = 0 00100000:10000000:2.0:1789043111.729378:0:15183:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 715: rc = 0 00100000:10000000:2.0:1789043111.729807:0:15183:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 715: rc = 0 00100000:10000000:2.0:1789043111.730108:0:15183:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 715: rc = 0 00100000:10000000:2.0:1789043111.730681:0:15183:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 715: rc = 0 00100000:10000000:2.0:1789043111.730918:0:15183:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 715: rc = 0 00100000:10000000:2.0:1789043111.731227:0:15183:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 715: rc = 0 00000020:00000080:2.0:1789043111.732037:0:15183:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789043111.732049:0:15183:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789043111.732117:0:15183:0:(genops.c:1393:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x99260d7389c06fee 00000020:01000004:2.0:1789043111.732126:0:15183:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789043111.732148:0:15183:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.117@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789043111.732151:0:15183:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.117@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789043111.732157:0:15183:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789043111.732162:0:15183:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789043111.732173:0:15183:0:(genops.c:415:class_newdev()) Allocate new device OSS (ffffa06a42f7b3b0) 00000020:00000080:2.0:1789043111.732192:0:15183:0:(obd_config.c:786:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1789043111.733595:0:15183:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789043111.733780:0:15183:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789043111.733787:0:15183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789043111.739424:0:15183:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789043111.739448:0:15183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789043111.739962:0:15183:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789043111.739969:0:15183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789043111.741449:0:15183:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789043111.741683:0:15183:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789043111.741691:0:15183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789043111.745111:0:15183:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789043111.745125:0:15183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789043111.772161:0:15183:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789043111.772733:0:15183:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789043111.772741:0:15183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789043111.774909:0:15183:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789043111.774923:0:15183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789043111.776011:0:15183:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789043111.776021:0:15183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789043111.781254:0:15183:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789043111.781457:0:15183:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789043111.781463:0:15183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789043111.782369:0:15183:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789043111.782377:0:15183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789043111.812915:0:15183:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789043111.813149:0:15183:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789043111.813157:0:15183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789043111.814506:0:15183:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789043111.814771:0:15183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789043111.815131:0:15183:0:(obd_config.c:900:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789043111.815153:0:15183:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1789043111.815159:0:15183:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.117@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789043111.825235:0:15183:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.117@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789043111.825287:0:15183:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.117@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1789043111.825296:0:15183:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789043111.825298:0:15183:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789043111.825299:0:15183:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789043111.825300:0:15183:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789043111.825301:0:15183:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789043111.825302:0:15183:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789043111.825303:0:15183:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789043111.825305:0:15183:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789043111.825306:0:15183:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789043111.825309:0:15183:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1789043111.825311:0:15183:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789043111.825312:0:15183:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789043111.825313:0:15183:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789043111.825314:0:15183:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789043111.825315:0:15183:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789043111.825316:0:15183:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789043111.825317:0:15183:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789043111.825317:0:15183:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789043111.825318:0:15183:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789043111.825343:0:15183:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789043111.825363:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a025c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267650944:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789043111.825452:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043111.825499:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a6d27d600 going to sleep for 11 seconds 00000100:00100000:0.0:1789043111.825780:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267650944 00000100:00100000:0.0:1789043111.825788:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267650944 00000100:00100000:0.0:1789043111.825836:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789043111.825846:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+12:15183:x1875947267650944:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789043111.825876:0:14493:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789043111.825880:0:14493:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1789043111.825883:0:14493:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789043111.834924:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+12:15183:x1875947267650944:12345-0@lo:253:mount.lustre.0 Request processed in 9071us (9464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043111.834937:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789043111.835038:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a025c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267650944:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789043111.835052:0:15183:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789043111.835056:0:15183:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789043111.835057:0:15183:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789043111.835059:0:15183:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789043111.835060:0:15183:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789043111.835061:0:15183:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789043111.835062:0:15183:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789043111.835064:0:15183:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789043111.835066:0:15183:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789043111.835067:0:15183:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789043111.835085:0:15183:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa06a763bb000 from lustre-OST0000 10000000:01000000:3.0:1789043111.835111:0:15183:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789043111.835113:0:15183:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789043111.835134:0:15183:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa06a7fae4d88 local copy 00010000:00010000:3.0:1789043111.835143:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6fa00/0x99260d7389c06ee4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06eeb expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043111.835395:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a025c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267651072:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789043111.835429:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043111.835546:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a6d27de40 going to sleep for 11 seconds 00000100:00100000:2.0:1789043111.838901:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267651072 00000100:00100000:2.0:1789043111.838914:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267651072 00000100:00100000:2.0:1789043111.839032:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789043111.839042:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+12:15183:x1875947267651072:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789043111.839323:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+12:15183:x1875947267651072:12345-0@lo:501:mount.lustre.0 Request processed in 283us (3892us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789043111.839331:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789043111.839409:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a025c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267651072:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789043111.839429:0:15183:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.117@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789043111.839668:0:15183:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.117@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789043111.839677:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6fa00/0x99260d7389c06ee4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06eeb expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043111.839688:0:15183:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6fa00/0x99260d7389c06ee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06eeb expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789043111.839711:0:15183:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa06a763bb000 10000000:01000000:3.0:1789043111.839716:0:15183:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789043111.839731:0:15183:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffffa06a7fae4d88 10000000:01000000:3.0:1789043111.839734:0:15183:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789043111.839737:0:15183:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffffa06a7fae4d88 from 1 10000000:01000000:3.0:1789043111.839740:0:15183:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789043111.839768:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28c00/0x99260d7389c06ffc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043111.839776:0:15183:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28c00/0x99260d7389c06ffc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043111.839785:0:15183:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28c00/0x99260d7389c06ffc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043111.839811:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a025c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267651200:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789043111.839843:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043111.844828:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267651200 00000100:00100000:1.0:1789043111.844843:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267651200 00000100:00100000:1.0:1789043111.844895:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789043111.844905:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7b786050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+12:15183:x1875947267651200:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789043111.844922:0:14493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043111.844941:0:14493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a41686c00/0x99260d7389c07003 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c06ffc expref: -99 pid: 14493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043111.844970:0:14493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a41686c00/0x99260d7389c07003 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c06ffc expref: 13 pid: 14493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043111.844981:0:14493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a41686c00/0x99260d7389c07003 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c06ffc expref: 13 pid: 14493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043111.844990:0:14493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41686c00, rc 0) 00000100:00100000:3.0:1789043111.845312:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a6d27de40 going to sleep for 11 seconds 00000100:00100000:1.0:1789043111.845503:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7b786050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+13:15183:x1875947267651200:12345-0@lo:101:mount.lustre.0 Request processed in 598us (5658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043111.845510:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789043111.845854:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a025c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267651200:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789043111.845872:0:15183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28c00/0x99260d7389c06ffc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c07003 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043111.845881:0:15183:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28c00/0x99260d7389c06ffc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c07003 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789043111.845903:0:15183:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789043111.845955:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28c00/0x99260d7389c06ffc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c07003 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043111.845964:0:15183:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28c00/0x99260d7389c06ffc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c07003 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789043111.845972:0:15183:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789043111.845977:0:15183:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789043111.845983:0:15183:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789043111.845985:0:15183:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789043111.846010:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a6fc29200/0x99260d7389c0700a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043111.846017:0:15183:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a6fc29200/0x99260d7389c0700a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043111.846026:0:15183:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a6fc29200/0x99260d7389c0700a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043111.846063:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a025c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267651328:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789043111.846101:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043111.846124:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a6d27de40 going to sleep for 11 seconds 00000100:00100000:0.0:1789043111.846170:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267651328 00000100:00100000:0.0:1789043111.846177:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267651328 00000100:00100000:1.0:1789043111.849214:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789043111.849229:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7b784050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+13:15183:x1875947267651328:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789043111.849261:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043111.849280:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a41686400/0x99260d7389c07011 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c0700a expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043111.849308:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a41686400/0x99260d7389c07011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c0700a expref: 14 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043111.849337:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a41686400/0x99260d7389c07011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c0700a expref: 14 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043111.849347:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41686400, rc 0) 00000100:00100000:1.0:1789043111.849426:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7b784050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+14:15183:x1875947267651328:12345-0@lo:101:mount.lustre.0 Request processed in 200us (3323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043111.849433:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789043111.849637:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a025c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267651328:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789043111.849657:0:15183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a6fc29200/0x99260d7389c0700a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c07011 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043111.849667:0:15183:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a6fc29200/0x99260d7389c0700a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c07011 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789043111.850911:0:15183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789043111.852869:0:15183:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789043111.853217:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789043111.853278:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789043111.853328:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789043111.853379:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789043111.853417:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789043111.853452:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789043111.853958:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789043111.853969:0:15183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789043111.854068:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a025c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267651456:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789043111.854135:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043111.854238:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a6d27d480 going to sleep for 11 seconds 00000100:00100000:1.0:1789043111.854343:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267651456 00000100:00100000:1.0:1789043111.854352:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267651456 00000100:00100000:1.0:1789043111.854404:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789043111.854414:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7b786850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+14:15183:x1875947267651456:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789043111.855209:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7b786850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+14:15183:x1875947267651456:12345-0@lo:501:mount.lustre.0 Request processed in 795us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043111.855219:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789043111.855973:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a025c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267651456:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789043111.856022:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a025c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267651584:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789043111.856073:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043111.856160:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a6d27d480 going to sleep for 11 seconds 00000100:00100000:0.0:1789043111.856197:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267651584 00000100:00100000:0.0:1789043111.856204:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267651584 00000100:00100000:0.0:1789043111.856295:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789043111.856305:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7b786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+14:15183:x1875947267651584:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789043111.856840:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7b786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+14:15183:x1875947267651584:12345-0@lo:503:mount.lustre.0 Request processed in 535us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043111.856848:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789043111.856931:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a025c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267651584:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789043111.857410:0:15183:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789043111.857474:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a025c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267651712:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789043111.857552:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043111.858197:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a6d27d480 going to sleep for 11 seconds 00000100:00100000:2.0:1789043111.858272:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267651712 00000100:00100000:2.0:1789043111.858279:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267651712 00000100:00100000:2.0:1789043111.858314:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789043111.858323:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7b787850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+14:15183:x1875947267651712:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789043111.860937:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7b787850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+14:15183:x1875947267651712:12345-0@lo:502:mount.lustre.0 Request processed in 2607us (3377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043111.860950:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789043111.863275:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a025c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267651712:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789043111.863628:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789043111.863688:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789043111.864069:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789043111.864143:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789043111.864184:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789043111.864219:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789043111.864277:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789043111.864315:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789043111.864360:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1789043111.864407:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1789043111.864441:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1789043111.864484:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1789043111.865041:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a025c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267651840:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789043111.865114:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043111.865157:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a6d27d480 going to sleep for 11 seconds 00000100:00100000:2.0:1789043111.865218:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267651840 00000100:00100000:2.0:1789043111.865225:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267651840 00000100:00100000:2.0:1789043111.865283:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789043111.865293:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7b784c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+14:15183:x1875947267651840:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789043111.865691:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7b784c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+14:15183:x1875947267651840:12345-0@lo:502:mount.lustre.0 Request processed in 331us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043111.865711:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789043111.865930:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a025c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267651840:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789043111.866015:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1789043111.866028:0:15183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1789043111.867292:0:15198:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789043111.867301:0:15198:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1789043111.867307:0:15198:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789043111.867309:0:15198:0:(obd_config.c:1661:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789043111.867315:0:15198:0:(obd_config.c:1570:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789043111.867330:0:15198:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0000 (ffffa06a5209cd88) 00000020:00000080:1.0:1789043111.867350:0:15198:0:(obd_config.c:786:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789043111.867355:0:15198:0:(obd_config.c:1570:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789043111.867478:0:15198:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa06a763bb000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789043111.867487:0:15198:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789043111.867493:0:15198:0:(genops.c:1393:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x99260d7389c0701f 00010000:00010000:1.0:1789043111.871894:0:15198:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1789043111.872309:0:15198:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1789043111.875063:0:15198:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1789043111.876459:0:15198:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789043111.876481:0:15198:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789043111.876487:0:15198:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789043111.876489:0:15198:0:(obd_config.c:1661:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789043111.876492:0:15198:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789043111.876495:0:15198:0:(obd_config.c:2000:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1789043111.876497:0:15198:0:(obd_config.c:2026:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789043111.876498:0:15198:0:(obd_config.c:2026:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789043111.876499:0:15198:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789043111.876502:0:15198:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789043111.876503:0:15198:0:(obd_config.c:1661:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789043111.876505:0:15198:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789043111.876508:0:15198:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789043111.876510:0:15198:0:(obd_config.c:1661:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789043111.876543:0:15198:0:(obd_config.c:1570:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789043111.876546:0:15198:0:(obd_config.c:1635:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789043111.876548:0:15198:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789043111.876551:0:15198:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789043111.876552:0:15198:0:(obd_config.c:1661:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789043111.876554:0:15198:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789043111.876557:0:15198:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789043111.876558:0:15198:0:(obd_config.c:1661:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789043111.876562:0:15198:0:(obd_config.c:1570:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789043111.876609:0:15198:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789043111.876612:0:15198:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789043111.876613:0:15198:0:(obd_config.c:1661:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789043111.876616:0:15198:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1789043111.876891:0:15183:0:(obd_config.c:2243:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1789043111.876917:0:15183:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789043111.876938:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a6fc29200/0x99260d7389c0700a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c07011 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043111.876958:0:15183:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a6fc29200/0x99260d7389c0700a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c07011 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789043111.876966:0:15183:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa06a763bb000 from 1 10000000:01000000:3.0:1789043111.876969:0:15183:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789043111.877003:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28200/0x99260d7389c07026 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043111.877011:0:15183:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28200/0x99260d7389c07026 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043111.877021:0:15183:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28200/0x99260d7389c07026 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043111.877046:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a025c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267651968:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789043111.877105:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043111.877139:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a6d27d480 going to sleep for 11 seconds 00000100:00100000:0.0:1789043111.877278:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267651968 00000100:00100000:0.0:1789043111.877284:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267651968 00000100:00100000:0.0:1789043111.877328:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789043111.877336:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7b785450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+14:15183:x1875947267651968:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789043111.877347:0:14495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789043111.877359:0:14495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a7fa6ec00/0x99260d7389c0702d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c07026 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043111.877390:0:14495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a7fa6ec00/0x99260d7389c0702d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c07026 expref: 15 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043111.877401:0:14495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a7fa6ec00/0x99260d7389c0702d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c07026 expref: 15 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043111.877408:0:14495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a7fa6ec00, rc 0) 00000100:00100000:0.0:1789043111.877446:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7b785450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+15:15183:x1875947267651968:12345-0@lo:101:mount.lustre.0 Request processed in 110us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043111.877452:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789043111.877857:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a025c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267651968:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789043111.877872:0:15183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28200/0x99260d7389c07026 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c0702d expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043111.877881:0:15183:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28200/0x99260d7389c07026 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c0702d expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789043111.878347:0:15183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789043111.878957:0:15183:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789043111.879197:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789043111.879251:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789043111.879330:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789043111.879339:0:15183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789043111.879403:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a025c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267652096:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789043111.879456:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043111.879505:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a6d27d480 going to sleep for 11 seconds 00000100:00100000:1.0:1789043111.879666:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267652096 00000100:00100000:1.0:1789043111.879673:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267652096 00000100:00100000:1.0:1789043111.879707:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789043111.879715:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7b786c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+15:15183:x1875947267652096:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789043111.880061:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7b786c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+15:15183:x1875947267652096:12345-0@lo:501:mount.lustre.0 Request processed in 346us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043111.880078:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789043111.881847:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a025c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267652096:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789043111.881897:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a025c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267652224:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789043111.881955:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043111.882853:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a6d27d480 going to sleep for 11 seconds 00000100:00100000:0.0:1789043111.883251:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267652224 00000100:00100000:0.0:1789043111.883260:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267652224 00000100:00100000:0.0:1789043111.883343:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789043111.883352:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7b787c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+15:15183:x1875947267652224:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789043111.883649:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7b787c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+15:15183:x1875947267652224:12345-0@lo:503:mount.lustre.0 Request processed in 297us (1693us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043111.883657:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789043111.883769:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a025c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267652224:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789043111.884274:0:15183:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789043111.884352:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a025c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267652352:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789043111.884400:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043111.888676:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a6d27d480 going to sleep for 11 seconds 00000100:00100000:2.0:1789043111.888831:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267652352 00000100:00100000:2.0:1789043111.888841:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267652352 00000100:00100000:2.0:1789043111.888881:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789043111.888890:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7b784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+15:15183:x1875947267652352:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789043111.889128:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7b784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+15:15183:x1875947267652352:12345-0@lo:502:mount.lustre.0 Request processed in 238us (4727us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043111.889135:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789043111.889226:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a025c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267652352:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789043111.889545:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789043111.889604:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789043111.889781:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789043111.889820:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789043111.889849:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789043111.889891:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789043111.889921:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789043111.889949:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1789043111.889984:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a025c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267652480:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789043111.890027:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043111.890049:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a6d27d480 going to sleep for 11 seconds 00000100:00100000:0.0:1789043111.890107:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267652480 00000100:00100000:0.0:1789043111.890112:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267652480 00000100:00100000:0.0:1789043111.890139:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789043111.890145:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a76599050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+15:15183:x1875947267652480:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789043111.890310:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a76599050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+15:15183:x1875947267652480:12345-0@lo:502:mount.lustre.0 Request processed in 164us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043111.890317:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789043111.891863:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a025c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267652480:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789043111.892036:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1789043111.892049:0:15183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1789043111.894191:0:15202:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789043111.894204:0:15202:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789043111.894206:0:15202:0:(obd_config.c:1661:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789043111.894213:0:15202:0:(obd_config.c:2102:class_config_llog_handler()) cmd ce032, instance name: general-ffffa06a763bb000 00000020:00000080:3.0:1789043111.894215:0:15202:0:(obd_config.c:1570:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789043111.894222:0:15202:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789043111.894224:0:15202:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789043111.894226:0:15202:0:(obd_config.c:1661:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789043111.894228:0:15202:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789043111.894230:0:15202:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789043111.894232:0:15202:0:(obd_config.c:1661:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789043111.894235:0:15202:0:(obd_config.c:2102:class_config_llog_handler()) cmd ce032, instance name: general-ffffa06a763bb000 00000020:00000080:3.0:1789043111.894236:0:15202:0:(obd_config.c:1570:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789043111.894302:0:15202:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789043111.894304:0:15202:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789043111.894306:0:15202:0:(obd_config.c:1661:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789043111.894308:0:15202:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789043111.894310:0:15202:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789043111.894312:0:15202:0:(obd_config.c:1661:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789043111.894315:0:15202:0:(obd_config.c:2102:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa06a763bb000 00000020:00000080:3.0:1789043111.894317:0:15202:0:(obd_config.c:1570:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789043111.894345:0:15202:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789043111.894348:0:15202:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789043111.894350:0:15202:0:(obd_config.c:1661:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789043111.894352:0:15202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1789043111.894540:0:15183:0:(obd_config.c:2243:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1789043111.894569:0:15183:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789043111.894589:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28200/0x99260d7389c07026 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c0702d expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043111.894602:0:15183:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28200/0x99260d7389c07026 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c0702d expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789043111.894653:0:15183:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789043111.894656:0:15183:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa06a763bb000 10000000:01000000:0.0:1789043111.894659:0:15183:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa06a763bb000 10000000:01000000:0.0:1789043111.894662:0:15183:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789043111.894668:0:15183:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa06a763bb000 from 1 10000000:01000000:0.0:1789043111.894670:0:15183:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789043111.894704:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6f200/0x99260d7389c07034 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043111.894713:0:15183:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6f200/0x99260d7389c07034 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043111.894863:0:15183:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6f200/0x99260d7389c07034 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043111.894887:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267652608:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789043111.894952:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043111.894992:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a50a62b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789043111.895801:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267652608 00000100:00100000:3.0:1789043111.895810:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267652608 00000100:00100000:3.0:1789043111.895852:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789043111.895860:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7659b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+15:15183:x1875947267652608:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789043111.895879:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789043111.895895:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c0703b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c07034 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043111.895918:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c0703b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c07034 expref: 16 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043111.895929:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a6fc29e00/0x99260d7389c0703b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c07034 expref: 16 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043111.895938:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc29e00, rc 0) 00000100:00100000:3.0:1789043111.895994:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7659b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+16:15183:x1875947267652608:12345-0@lo:101:mount.lustre.0 Request processed in 134us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043111.896001:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789043111.896996:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267652608:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789043111.897018:0:15183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6f200/0x99260d7389c07034 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c0703b expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043111.897029:0:15183:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6f200/0x99260d7389c07034 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c0703b expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789043111.897883:0:15183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1789043111.898446:0:15183:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789043111.903992:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789043111.904088:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1789043111.904120:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1789043111.904163:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1789043111.904200:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1789043111.904273:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1789043111.904311:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1789043111.904347:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1789043111.904394:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1789043111.904429:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1789043111.904462:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1789043111.904505:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1789043111.904566:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1789043111.904598:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1789043111.907967:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1789043111.908045:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1789043111.908084:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1789043111.908160:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1789043111.908195:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1789043111.908229:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1789043111.911851:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1789043111.911918:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1789043111.911953:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1789043111.911998:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1789043111.912030:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1789043111.912059:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1789043111.912098:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1789043111.912129:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1789043111.912218:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1789043111.912228:0:15183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1789043111.912355:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267652736:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789043111.912443:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043111.912546:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267652736 00000100:00100000:0.0:1789043111.912554:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267652736 00000100:00100000:0.0:1789043111.912601:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789043111.912610:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7659b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+16:15183:x1875947267652736:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789043111.918076:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7659b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+16:15183:x1875947267652736:12345-0@lo:501:mount.lustre.0 Request processed in 5457us (5624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043111.918091:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789043111.918174:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a50a62b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789043111.918204:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267652736:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789043111.918273:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267652864:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789043111.918328:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043111.918361:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a50a62b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789043111.920233:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267652864 00000100:00100000:1.0:1789043111.920256:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267652864 00000100:00100000:1.0:1789043111.920303:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789043111.920312:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7659ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+16:15183:x1875947267652864:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789043111.920560:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7659ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+16:15183:x1875947267652864:12345-0@lo:503:mount.lustre.0 Request processed in 248us (2231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043111.920568:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789043111.921467:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267652864:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789043111.922957:0:15183:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789043111.923055:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267652992:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789043111.923131:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043111.923182:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a50a62b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789043111.923302:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267652992 00000100:00100000:1.0:1789043111.923310:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267652992 00000100:00100000:1.0:1789043111.923361:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789043111.923383:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7659a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+16:15183:x1875947267652992:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789043111.923847:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7659a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+16:15183:x1875947267652992:12345-0@lo:502:mount.lustre.0 Request processed in 475us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043111.923856:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789043111.925146:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267652992:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789043111.925497:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789043111.925586:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789043111.925617:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789043111.929975:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789043111.930025:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789043111.930071:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789043111.930104:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789043111.930135:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789043111.930177:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789043111.930212:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789043111.930256:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789043111.930331:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789043111.930374:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789043111.930405:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789043111.930454:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789043111.930489:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789043111.930590:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789043111.932949:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789043111.933024:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789043111.933060:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789043111.933127:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789043111.933176:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789043111.933212:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789043111.933273:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789043111.933314:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1789043111.933344:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1789043111.933384:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1789043111.933414:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1789043111.933443:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1789043111.933481:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1789043111.933535:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1789043111.933569:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1789043111.933599:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1789043111.935880:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1789043111.935942:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1789043111.935987:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1789043111.936017:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1789043111.936046:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1789043111.936693:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1789043111.936810:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1789043111.936863:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267653120:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789043111.936942:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043111.936987:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267653120 00000100:00100000:0.0:1789043111.936994:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267653120 00000100:00100000:0.0:1789043111.937038:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789043111.937047:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7659a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+16:15183:x1875947267653120:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789043111.937272:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7659a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+16:15183:x1875947267653120:12345-0@lo:502:mount.lustre.0 Request processed in 224us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043111.937280:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789043111.937335:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a50a62b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789043111.937357:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267653120:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789043111.937427:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1789043111.937437:0:15183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1789043111.948923:0:15207:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789043111.948943:0:15207:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffffa06a42f7cd88) 00000020:00000080:2.0:1789043111.948965:0:15207:0:(obd_config.c:786:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1789043111.949052:0:15207:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa06a763bb000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789043111.949057:0:15207:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa06a763bb000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789043111.949060:0:15207:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa06a763bb000 3 00010000:00080000:2.0:1789043111.949091:0:15207:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa06a7f9ee800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.117@tcp at head 00010000:00010000:2.0:1789043111.950776:0:15207:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1789043111.950959:0:15207:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789043111.950996:0:15207:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789043111.951011:0:15207:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x99260d7389c07049 00000100:00080000:2.0:1789043111.951022:0:15207:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789043111.951028:0:15207:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffffa06a7f9ee800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:2.0:1789043111.951080:0:15207:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa06a7f8c7100 x1875947267653248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789043111.951118:0:15207:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789043111.951426:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875947267653248:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789043111.951494:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789043111.951575:0:470:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789043111.951580:0:470:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789043111.951583:0:470:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789043111.951586:0:470:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789043111.953916:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267653376:0@lo:400:kworker.0 00000100:00100000:0.0:1789043111.953983:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1789043111.954352:0:15207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1789043111.954466:0:15183:0:(obd_config.c:2243:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789043111.954491:0:15183:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789043111.954507:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6f200/0x99260d7389c07034 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c0703b expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043111.954542:0:15183:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6f200/0x99260d7389c07034 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c0703b expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789043111.954593:0:15183:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789043111.954595:0:15183:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789043111.954596:0:15183:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789043111.954601:0:15183:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789043111.954603:0:15183:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789043111.954604:0:15183:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789043111.954605:0:15183:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789043111.954607:0:15183:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789043111.954608:0:15183:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789043111.954612:0:15183:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1789043111.954614:0:15183:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789043111.954616:0:15183:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789043111.954617:0:15183:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789043111.954618:0:15183:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789043111.954619:0:15183:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789043111.954620:0:15183:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789043111.954621:0:15183:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789043111.954701:0:15183:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789043111.954703:0:15183:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789043111.954782:0:15183:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789043111.954797:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edb8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267653504:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789043111.954849:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043111.954874:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a5135e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789043111.954936:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267653504 00000100:00100000:0.0:1789043111.954942:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267653504 00000100:00100000:0.0:1789043111.954987:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789043111.954995:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a76599850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+16:15183:x1875947267653504:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789043111.955019:0:14495:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789043111.955032:0:14495:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1789043111.956236:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267653248 00000100:00100000:2.0:1789043111.956256:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267653248 00000100:00100000:2.0:1789043111.956278:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267653376 00000100:00100000:2.0:1789043111.956290:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267653376 00000100:00100000:2.0:1789043111.956314:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789043111.956321:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267653376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789043111.956393:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267653376:12345-0@lo:400:kworker.0 Request processed in 72us (2410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043111.956400:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789043111.956415:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789043111.956419:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1875947267653248:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789043111.956439:0:14501:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 454 last 0 00000020:00000080:2.0:1789043111.956471:0:14501:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x99260d7389c07050 00000004:00100000:2.0:1789043111.956485:0:14501:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789043111.956528:0:14501:0:(import.c:65:import_set_state_nolock()) ffffa06a7f9ea000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789043111.956566:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875947267653248:12345-0@lo:38:llog_process_th.0 Request processed in 145us (5072us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043111.956572:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789043111.957603:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa06a7a027b80 x1875947267653376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789043127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789043111.957619:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267653376:0@lo:400:kworker.0 00010000:00080000:3.0:1789043111.958097:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa06a7f8c7100 x1875947267653248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789043121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789043111.958108:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789043111.958115:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789043111.958123:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789043111.958127:0:3311:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789043111.958141:0:3311:0:(import.c:65:import_set_state_nolock()) ffffa06a7f9ee800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789043111.958148:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875947267653248:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1789043111.991250:0:14495:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789043111.991270:0:14495:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789043111.994013:0:14517:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789043111.994024:0:14517:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789043111.994047:0:14517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa06a7fa6ea00/0x99260d7389c07057 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043111.994067:0:14517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a6fc29000/0x99260d7389c06fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c06fbd expref: 16 pid: 14493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043111.994075:0:14517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa06a7fa6ea00/0x99260d7389c07057 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043111.994122:0:14517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a6fc29000/0x99260d7389c06fc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99260d7389c06fbd expref: 16 pid: 14493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043111.994137:0:14517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa06a6fc29000/0x99260d7389c06fc4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99260d7389c06fbd expref: 16 pid: 14493 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043111.994150:0:14517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767e8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14517:1875947267653632:0@lo:104: 00000100:00100000:0.0:1789043111.994212:0:14517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043111.994280:0:14517:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a50a62f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789043111.994350:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267653632 00000100:00100000:2.0:1789043111.994358:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267653632 00000100:00100000:2.0:1789043111.994407:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789043111.994417:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff892c07-94a8-4144-ae30-5a70a83d490b+3:14517:x1875947267653632:12345-0@lo:104: 00010000:00010000:2.0:1789043111.994429:0:14485:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffffa06a50978600/0x99260d7389c06fbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c06fc4 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043111.994489:0:14485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789043111.994496:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff892c07-94a8-4144-ae30-5a70a83d490b+3:14517:x1875947267653632:12345-0@lo:104: Request processed in 81us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043111.994536:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789043111.994557:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789043111.994562:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a50978600/0x99260d7389c06fbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c06fc4 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043111.994569:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50978600 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:2.0:1789043111.994572:0:14489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a50978600/0x99260d7389c06fbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x99260d7389c06fc4 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043111.994581:0:14489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a50978600/0x99260d7389c06fbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x99260d7389c06fc4 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789043111.994588:0:14489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a50978600/0x99260d7389c06fbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x99260d7389c06fc4 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789043111.994593:0:14489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789043111.994853:0:14489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a50978600/0x99260d7389c06fbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c06fc4 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043111.994862:0:14489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789043111.994930:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a50978600/0x99260d7389c06fbd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c06fc4 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043111.994937:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a50978600/0x99260d7389c06fbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c06fc4 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043111.994954:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043111.994956:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043111.994958:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789043111.994972:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789043111.994990:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff892c07-94a8-4144-ae30-5a70a83d490b:3314:1875947267653760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789043111.995022:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043111.995058:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267653760 00000100:00100000:2.0:1789043111.995062:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267653760 00010000:00010000:2.0:1789043111.995078:0:14488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a6fc29000/0x99260d7389c06fc4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c06fbd expref: 17 pid: 14493 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043111.995100:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789043111.995107:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ff892c07-94a8-4144-ae30-5a70a83d490b+17:3314:x1875947267653760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789043111.995118:0:14488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789043111.995123:0:14488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a6fc29000/0x99260d7389c06fc4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c06fbd expref: 17 pid: 14493 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043111.995133:0:14488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a6fc29000/0x99260d7389c06fc4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99260d7389c06fbd expref: 17 pid: 14493 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043111.995148:0:14488:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa06a7fa6ea00/0x99260d7389c07057 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043111.995157:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a7fa6ea00/0x99260d7389c07057 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789043111.995170:0:14488:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001147428s 00010000:00010000:2.0:1789043111.995175:0:14488:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa06a7fa6ea00/0x99260d7389c07057 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043111.995181:0:14488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa06a7fa6ea00/0x99260d7389c07057 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043111.995188:0:14488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa06a7fa6ea00/0x99260d7389c07057 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043111.995205:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa06a7fa6ea00/0x99260d7389c07057 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043111.995211:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a7fa6ea00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:2.0:1789043111.995214:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa06a7fa6ea00/0x99260d7389c07057 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043111.995221:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa06a7fa6ea00/0x99260d7389c07057 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043111.995229:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa06a7fa6ea00/0x99260d7389c07057 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043111.995239:0:14488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789043111.995281:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ff892c07-94a8-4144-ae30-5a70a83d490b+17:3314:x1875947267653760:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043111.995288:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789043111.995323:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff892c07-94a8-4144-ae30-5a70a83d490b:3314:1875947267653760:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789043111.995403:0:14517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a6fc29000/0x99260d7389c06fc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99260d7389c06fbd expref: 16 pid: 14493 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043111.995415:0:14517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767e8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14517:1875947267653632:0@lo:104: 00010000:00010000:0.0:1789043111.995426:0:14517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa06a7fa6ea00/0x99260d7389c07057 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043111.995435:0:14517:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa06a7fa6ea00/0x99260d7389c07057 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043111.995441:0:14517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa06a7fa6ea00/0x99260d7389c07057 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043111.995448:0:14517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a7fa6ea00/0x99260d7389c07057 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043112.013587:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a76599850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+15:15183:x1875947267653504:12345-0@lo:253:mount.lustre.0 Request processed in 58576us (58721us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043112.013608:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789043112.013614:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edb8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15183:1875947267653504:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789043112.013753:0:15183:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789043112.013757:0:15183:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789043112.013759:0:15183:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789043112.013760:0:15183:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789043112.013761:0:15183:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789043112.013762:0:15183:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789043112.013764:0:15183:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789043112.013765:0:15183:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789043112.013767:0:15183:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789043112.013768:0:15183:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789043112.013785:0:15183:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789043112.020998:0:15183:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1789043112.021166:0:15183:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789043112.021336:0:15183:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789043112.021494:0:15183:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789043112.021691:0:15183:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789043112.021929:0:15183:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789043112.023701:0:15183:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1789043112.083147:0:15183:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789043112.083158:0:15183:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789043112.083194:0:15183:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789043112.083265:0:15183:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.117@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789043112.083280:0:15183:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789043112.083314:0:15183:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1789043112.571331:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043113.591571:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789043113.974419:0:14499:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789043113.974428:0:14499:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa06a7f846000 from 7 10000000:01000000:1.0:1789043113.974435:0:14499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789043113.974479:0:14499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41686800/0x99260d7389c0705e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043113.974491:0:14499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a41686800/0x99260d7389c0705e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043113.974502:0:14499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a41686800/0x99260d7389c0705e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043113.974554:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edb8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff892c07-94a8-4144-ae30-5a70a83d490b:14499:1875947267653888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789043113.974624:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043113.974677:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a472d5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789043113.974763:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267653888 00000100:00100000:2.0:1789043113.974772:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267653888 00000100:00100000:2.0:1789043113.974821:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789043113.974831:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a76598050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+15:14499:x1875947267653888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789043113.974844:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043113.974865:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a50979e00/0x99260d7389c07065 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c0705e expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043113.974888:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a50979e00/0x99260d7389c07065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c0705e expref: 16 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043113.974899:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a50979e00/0x99260d7389c07065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c0705e expref: 16 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043113.974908:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50979e00, rc 0) 00000100:00100000:2.0:1789043113.974950:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a76598050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+16:14499:x1875947267653888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043113.974957:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789043113.975012:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edb8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff892c07-94a8-4144-ae30-5a70a83d490b:14499:1875947267653888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789043113.975026:0:14499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a41686800/0x99260d7389c0705e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c07065 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043113.975035:0:14499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a41686800/0x99260d7389c0705e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c07065 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043113.975092:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff892c07-94a8-4144-ae30-5a70a83d490b:14499:1875947267654016:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789043113.975124:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043113.975140:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a46f1eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789043113.975152:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267654016 00000100:00100000:2.0:1789043113.975156:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267654016 00000100:00100000:2.0:1789043113.975178:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789043113.975185:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a76599450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+16:14499:x1875947267654016:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789043113.975198:0:14495:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789043113.975217:0:14495:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789043113.975220:0:14495:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789043113.975377:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a76599450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+16:14499:x1875947267654016:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 120us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043113.975384:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789043113.975417:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff892c07-94a8-4144-ae30-5a70a83d490b:14499:1875947267654016:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789043113.975471:0:14499:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789043113.975478:0:14499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41686800/0x99260d7389c0705e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c07065 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043113.975487:0:14499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a41686800/0x99260d7389c0705e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c07065 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043114.611993:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043115.634816:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043116.658860:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789043117.298870:0:470:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789043117.298932:0:470:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789043117.298935:0:470:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789043117.298937:0:470:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789043117.298993:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff892c07-94a8-4144-ae30-5a70a83d490b:3312:1875947267654144:0@lo:400:kworker.0 00000100:00100000:3.0:1789043117.299063:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043117.299108:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789043117.299114:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875947267654272:0@lo:400:kworker.0 00000100:00100000:3.0:1789043117.299140:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043117.299168:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789043117.299174:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875947267654400:0@lo:400:kworker.0 00000100:00100000:3.0:1789043117.299194:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043117.299333:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267654144 00000100:00100000:2.0:1789043117.299343:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267654144 00000100:00100000:2.0:1789043117.299383:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789043117.299392:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a76599c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+16:3312:x1875947267654144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789043117.299484:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267654272 00000100:00100000:3.0:1789043117.299489:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267654272 00000100:00100000:3.0:1789043117.299529:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267654400 00000100:00100000:3.0:1789043117.299531:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267654400 00000100:00100000:3.0:1789043117.299554:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789043117.299560:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875947267654272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789043117.304799:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a76599c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+16:3312:x1875947267654144:12345-0@lo:400:kworker.0 Request processed in 5396us (5724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043117.304814:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789043117.304864:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875947267654272:12345-0@lo:400:kworker.0 Request processed in 5227us (5646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043117.304881:0:14501:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789043117.304890:0:14501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789043117.304931:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789043117.304958:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789043117.304983:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875947267654400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789043117.305126:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875947267654400:12345-0@lo:400:kworker.0 Request processed in 147us (5930us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043117.305135:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789043117.305179:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789043117.305226:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a7a025180 x1875947267654400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789043133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789043117.305241:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875947267654400:0@lo:400:kworker.0 00010000:00080000:2.0:1789043117.305455:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a7a024e00 x1875947267654272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789043133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789043117.305466:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875947267654272:0@lo:400:kworker.0 00000100:00100000:2.0:1789043117.305489:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff892c07-94a8-4144-ae30-5a70a83d490b:3312:1875947267654144:0@lo:400:kworker.0 00010000:00010000:0.0:1789043117.682642:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789043118.159837:0:15551:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789043118.706824:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043119.730769:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789043120.051472:0:14533:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789043120.754826:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043121.778795:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789043122.418637:0:470:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789043122.418645:0:470:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789043122.418648:0:470:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789043122.418651:0:470:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789043122.418713:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ff892c07-94a8-4144-ae30-5a70a83d490b:3315:1875947267654528:0@lo:400:kworker.0 00000100:00100000:3.0:1789043122.418794:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043122.418868:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875947267654656:0@lo:400:kworker.0 00000100:00100000:1.0:1789043122.418895:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267654528 00000100:00100000:3.0:1789043122.418901:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043122.418906:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267654528 00000100:00100000:3.0:1789043122.418926:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789043122.418937:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875947267654784:0@lo:400:kworker.0 00000100:00100000:3.0:1789043122.418962:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043122.418987:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267654656 00000100:00100000:3.0:1789043122.418994:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267654784 00000100:00100000:3.0:1789043122.418998:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267654784 00000100:00100000:1.0:1789043122.419046:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789043122.419047:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267654656 00000100:00100000:1.0:1789043122.419061:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7659a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+16:3315:x1875947267654528:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789043122.419086:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789043122.419087:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789043122.419099:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875947267654784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789043122.419105:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789043122.419116:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875947267654656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789043122.419157:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875947267654784:12345-0@lo:400:kworker.0 Request processed in 60us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043122.419166:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789043122.419180:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875947267654656:12345-0@lo:400:kworker.0 Request processed in 55us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043122.419189:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789043122.419232:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a7a024e00 x1875947267654784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789043138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789043122.419239:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7659a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+16:3315:x1875947267654528:12345-0@lo:400:kworker.0 Request processed in 180us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043122.419251:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875947267654784:0@lo:400:kworker.0 00000100:00100000:1.0:1789043122.419251:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1789043122.419269:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a7a024700 x1875947267654656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789043138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789043122.419278:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875947267654656:0@lo:400:kworker.0 00000100:00100000:3.0:1789043122.419304:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ff892c07-94a8-4144-ae30-5a70a83d490b:3315:1875947267654528:0@lo:400:kworker.0 00010000:00010000:2.0:1789043122.803948:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789043123.187831:0:3311:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789043108/real 1789043108] req@ffffa06a6edb8380 x1875947267650176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789043123 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789043123.187860:0:3311:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa06a6edb8380 x1875947267650176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789043123 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789043123.187871:0:3311:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789043108/real 1789043108] req@ffffa06a6edb9f80 x1875947267650304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789043123 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789043123.187882:0:3311:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa06a6edb9f80 x1875947267650304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789043123 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789043123.187901:0:3311:0:(import.c:65:import_set_state_nolock()) ffffa06a55f6e800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789043123.187917:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789043123.187921:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875947267650176:0@lo:8:kworker.0 00000100:00080000:1.0:1789043123.187927:0:3311:0:(import.c:65:import_set_state_nolock()) ffffa06a7730f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789043123.187933:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789043123.187936:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875947267650304:0@lo:8:kworker.0 00000100:00080000:2.0:1789043123.189284:0:470:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789043123.189297:0:470:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789043123.189300:0:470:0:(import.c:65:import_set_state_nolock()) ffffa06a55f6e800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789043123.189307:0:470:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 451 00000100:00080000:2.0:1789043123.189313:0:470:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789043123.189320:0:470:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa06a55f6e800 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:2.0:1789043123.189341:0:470:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa06a7f8c6680 x1875947267655040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789043123.189358:0:470:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789043123.189361:0:470:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789043123.189362:0:470:0:(import.c:65:import_set_state_nolock()) ffffa06a7730f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789043123.189365:0:470:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 451 00000100:00080000:2.0:1789043123.189368:0:470:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789043123.189381:0:470:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa06a7730f000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:2.0:1789043123.189394:0:470:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa06a7f8c5180 x1875947267655168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789043123.189444:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875947267655040:0@lo:8:kworker.0 00000100:00100000:2.0:1789043123.189505:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043123.189576:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875947267655168:0@lo:8:kworker.0 00000100:00100000:2.0:1789043123.189598:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043123.189625:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875947267655424:0@lo:400:kworker.0 00000100:00100000:0.0:1789043123.189790:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff892c07-94a8-4144-ae30-5a70a83d490b:3314:1875947267654912:0@lo:400:kworker.0 00000100:00100000:0.0:1789043123.189826:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043123.189854:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789043123.189860:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267655296:0@lo:400:kworker.0 00000100:00100000:0.0:1789043123.189884:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043123.189914:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267654912 00000100:00100000:0.0:1789043123.189922:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267654912 00000100:00100000:0.0:1789043123.189977:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789043123.189987:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a76598450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+16:3314:x1875947267654912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789043123.190033:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a76598450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+16:3314:x1875947267654912:12345-0@lo:400:kworker.0 Request processed in 47us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043123.190046:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789043123.190080:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267655296 00000100:00100000:0.0:1789043123.190084:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267655296 00000100:00100000:0.0:1789043123.190112:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789043123.190118:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267655296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789043123.190149:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267655296:12345-0@lo:400:kworker.0 Request processed in 32us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043123.190155:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789043123.190202:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a7f8c5c00 x1875947267655296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789043139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789043123.190216:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267655296:0@lo:400:kworker.0 00000100:00100000:0.0:1789043123.190226:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff892c07-94a8-4144-ae30-5a70a83d490b:3314:1875947267654912:0@lo:400:kworker.0 00000100:00100000:2.0:1789043123.190402:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043123.190455:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267655040 00000100:00100000:2.0:1789043123.190460:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267655040 00000100:00100000:2.0:1789043123.190476:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267655168 00000100:00100000:2.0:1789043123.190479:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267655168 00000100:00100000:2.0:1789043123.190489:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789043123.190494:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3311:x1875947267655040:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789043123.190542:0:15185:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 466 last 0 00000020:00000080:2.0:1789043123.190573:0:15185:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x99260d7389c0706c 00002000:00100000:2.0:1789043123.190586:0:15185:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffffa06a7f9eb000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789043123.190590:0:15185:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1789043123.190593:0:15185:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1789043123.191442:0:15492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267655424 00000100:00100000:0.0:1789043123.191450:0:15492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267655424 00000100:00100000:0.0:1789043123.191490:0:15492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789043123.191499:0:15492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875947267655424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789043123.191575:0:15492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875947267655424:12345-0@lo:400:kworker.0 Request processed in 77us (1173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043123.191582:0:15492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789043123.191626:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a7f8c4000 x1875947267655424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789043139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789043123.191638:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875947267655424:0@lo:400:kworker.0 00002000:00080000:2.0:1789043123.194914:0:15185:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789043123.196369:0:15185:0:(import.c:65:import_set_state_nolock()) ffffa06a7f9ee000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789043123.196540:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1875947267655040:12345-0@lo:8:kworker.0 Request processed in 6041us (7032us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043123.196549:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789043123.196580:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789043123.196602:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3311:x1875947267655168:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789043123.196620:0:15185:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789043123.196667:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3311:x1875947267655168:12345-0@lo:8:kworker.0 Request processed in 64us (7067us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789043123.196673:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789043123.198975:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a7f8c6680 x1875947267655040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789043143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789043123.198989:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789043123.198998:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789043123.199007:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789043123.199020:0:3311:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789043123.199024:0:3311:0:(import.c:65:import_set_state_nolock()) ffffa06a55f6e800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789043123.199041:0:3311:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789043123.199047:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875947267655040:0@lo:8:kworker.0 00000004:00080000:3.0:1789043123.199053:0:14523:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00080000:1.0:1789043123.199286:0:3311:0:(import.c:65:import_set_state_nolock()) ffffa06a7730f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789043123.199292:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789043123.199296:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875947267655168:0@lo:8:kworker.0 00000004:00080000:3.0:1789043123.199365:0:14523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 466155849993ns, next at 0ns, rc = 0 00000100:00100000:3.0:1789043123.199508:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267655552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789043123.199842:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1789043123.199984:0:14524:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:0.0:1789043123.200005:0:14524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767e8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14524:1875947267655680:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789043123.200041:0:14524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043123.200056:0:14524:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a46eb2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789043123.200079:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267655680 00000100:00100000:0.0:1789043123.200085:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267655680 00000100:00100000:0.0:1789043123.200130:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789043123.200138:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14524:x1875947267655680:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789043123.202050:0:15189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267655552 00000100:00100000:3.0:1789043123.202061:0:15189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267655552 00000100:00100000:3.0:1789043123.202103:0:15189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789043123.202113:0:15189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a025180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875947267655552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789043123.202145:0:15189:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789043123.202232:0:15189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a025180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875947267655552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (2389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043123.202238:0:15189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789043123.202286:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a767e9880 x1875947267655552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789043139 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789043123.202323:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267655552:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789043123.203056:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1789043123.205419:0:15187:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1789043123.205430:0:15187:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1789043123.205436:0:15187:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:0.0:1789043123.212468:0:15187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789043123.212480:0:15187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cfde0f6/0x99260d7389c07073 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.212497:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1789043123.212502:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043123.212509:0:15187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cfde0f6/0x99260d7389c07073 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.212806:0:15187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cfde0f6/0x99260d7389c07073 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.212818:0:15187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cfde0f6/0x99260d7389c07073 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.212825:0:15187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cfde0f6/0x99260d7389c07073 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.212856:0:15187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789043123.212870:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789043123.212876:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cfde0f6/0x99260d7389c07073 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.212884:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a7fa6fc00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789043123.212888:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cfde0f6/0x99260d7389c07073 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.212897:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cfde0f6/0x99260d7389c07073 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.212913:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cfde0f6/0x99260d7389c07073 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.212921:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cfde0f6/0x99260d7389c07073 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.212938:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043123.212940:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043123.212942:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789043123.213618:0:15187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789043123.213625:0:15187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007810de65/0x99260d7389c0707a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.213635:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1789043123.213710:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043123.213715:0:15187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007810de65/0x99260d7389c0707a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.213726:0:15187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007810de65/0x99260d7389c0707a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.213734:0:15187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007810de65/0x99260d7389c0707a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.213742:0:15187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007810de65/0x99260d7389c0707a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.213799:0:15187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789043123.214251:0:15187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789043123.214258:0:15187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0226071/0x99260d7389c07081 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.214267:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1789043123.214270:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043123.214274:0:15187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0226071/0x99260d7389c07081 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.214283:0:15187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0226071/0x99260d7389c07081 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.214291:0:15187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0226071/0x99260d7389c07081 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.214305:0:15187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0226071/0x99260d7389c07081 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043123.214385:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789043123.214392:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007810de65/0x99260d7389c0707a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043123.214399:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a7fa6e000 already unused, calling callback (ffffffffc1470760) 00010000:00010000:2.0:1789043123.214403:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007810de65/0x99260d7389c0707a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043123.214412:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007810de65/0x99260d7389c0707a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043123.214429:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007810de65/0x99260d7389c0707a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043123.214436:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007810de65/0x99260d7389c0707a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043123.214451:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789043123.214454:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0226071/0x99260d7389c07081 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043123.214471:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a7fa6f400 already unused, calling callback (ffffffffc1470760) 00010000:00010000:2.0:1789043123.214475:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0226071/0x99260d7389c07081 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043123.214482:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0226071/0x99260d7389c07081 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043123.214492:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0226071/0x99260d7389c07081 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043123.214500:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043123.214502:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043123.214504:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043123.214567:0:15187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789043123.214572:0:15187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0226071/0x99260d7389c07081 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789043123.215042:0:15187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789043123.215048:0:15187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b06f3f8e/0x99260d7389c07088 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.215056:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1789043123.215058:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043123.215062:0:15187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b06f3f8e/0x99260d7389c07088 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.215072:0:15187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b06f3f8e/0x99260d7389c07088 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.215079:0:15187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b06f3f8e/0x99260d7389c07088 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.215086:0:15187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b06f3f8e/0x99260d7389c07088 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.215117:0:15187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789043123.215127:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789043123.215131:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b06f3f8e/0x99260d7389c07088 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.215138:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a7fa6e600 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789043123.215142:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b06f3f8e/0x99260d7389c07088 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.215150:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b06f3f8e/0x99260d7389c07088 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.215161:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b06f3f8e/0x99260d7389c07088 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.215179:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b06f3f8e/0x99260d7389c07088 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.215192:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043123.215194:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043123.215196:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789043123.215596:0:15187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789043123.215602:0:15187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000711f751f/0x99260d7389c0708f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.215610:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1789043123.215620:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043123.215625:0:15187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000711f751f/0x99260d7389c0708f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.215635:0:15187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000711f751f/0x99260d7389c0708f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.215643:0:15187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000711f751f/0x99260d7389c0708f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.215649:0:15187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000711f751f/0x99260d7389c0708f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.215663:0:15187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789043123.215672:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789043123.215676:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000711f751f/0x99260d7389c0708f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.215683:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a7fa6ee00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789043123.215686:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000711f751f/0x99260d7389c0708f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.215694:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000711f751f/0x99260d7389c0708f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.215706:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000711f751f/0x99260d7389c0708f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.215725:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000711f751f/0x99260d7389c0708f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.215739:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043123.215741:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043123.215743:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789043123.216289:0:15187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789043123.216295:0:15187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd4b2475/0x99260d7389c07096 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.216304:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1789043123.216307:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043123.216311:0:15187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd4b2475/0x99260d7389c07096 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.216320:0:15187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd4b2475/0x99260d7389c07096 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.216328:0:15187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd4b2475/0x99260d7389c07096 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.216335:0:15187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd4b2475/0x99260d7389c07096 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.216350:0:15187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789043123.216359:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789043123.216369:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd4b2475/0x99260d7389c07096 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.216377:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a7fa6ea00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789043123.216381:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd4b2475/0x99260d7389c07096 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.216389:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd4b2475/0x99260d7389c07096 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.216401:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd4b2475/0x99260d7389c07096 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.216409:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd4b2475/0x99260d7389c07096 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.216424:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043123.216425:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043123.216427:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789043123.216916:0:15187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789043123.216924:0:15187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ceac0f5c/0x99260d7389c0709d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.216933:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1789043123.216942:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043123.216959:0:15187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ceac0f5c/0x99260d7389c0709d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.216980:0:15187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ceac0f5c/0x99260d7389c0709d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.216989:0:15187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ceac0f5c/0x99260d7389c0709d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.216996:0:15187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ceac0f5c/0x99260d7389c0709d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.217011:0:15187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789043123.217020:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789043123.217024:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ceac0f5c/0x99260d7389c0709d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.217031:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a7fa6e800 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789043123.217034:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ceac0f5c/0x99260d7389c0709d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.217042:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ceac0f5c/0x99260d7389c0709d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.217054:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ceac0f5c/0x99260d7389c0709d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.217062:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ceac0f5c/0x99260d7389c0709d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.217083:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043123.217085:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043123.217086:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789043123.217605:0:15187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789043123.217612:0:15187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5340847/0x99260d7389c070a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.217621:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1789043123.217624:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043123.217628:0:15187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5340847/0x99260d7389c070a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.217637:0:15187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5340847/0x99260d7389c070a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.217655:0:15187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5340847/0x99260d7389c070a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.217662:0:15187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5340847/0x99260d7389c070a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.217677:0:15187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789043123.217686:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789043123.217690:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5340847/0x99260d7389c070a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.217707:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a7fa6e200 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789043123.217711:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5340847/0x99260d7389c070a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.217719:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5340847/0x99260d7389c070a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.217730:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5340847/0x99260d7389c070a4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.217737:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5340847/0x99260d7389c070a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.217751:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043123.217752:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043123.217754:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789043123.218295:0:15187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789043123.218303:0:15187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6ef0b6/0x99260d7389c070ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.218312:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1789043123.218315:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043123.218319:0:15187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6ef0b6/0x99260d7389c070ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.218328:0:15187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6ef0b6/0x99260d7389c070ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.218345:0:15187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6ef0b6/0x99260d7389c070ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.218353:0:15187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6ef0b6/0x99260d7389c070ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.218367:0:15187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789043123.218377:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789043123.218380:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6ef0b6/0x99260d7389c070ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.218393:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a7fa6e400 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789043123.218396:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6ef0b6/0x99260d7389c070ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.218402:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6ef0b6/0x99260d7389c070ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.218417:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6ef0b6/0x99260d7389c070ab lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.218425:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6ef0b6/0x99260d7389c070ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.218440:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043123.218448:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043123.218449:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789043123.219031:0:15187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789043123.219038:0:15187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d43f5e1/0x99260d7389c070b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.219051:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1789043123.219057:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043123.219062:0:15187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d43f5e1/0x99260d7389c070b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.219070:0:15187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d43f5e1/0x99260d7389c070b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.219077:0:15187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d43f5e1/0x99260d7389c070b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.219085:0:15187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d43f5e1/0x99260d7389c070b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.219103:0:15187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789043123.219113:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789043123.219117:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d43f5e1/0x99260d7389c070b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.219125:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a413a0a00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789043123.219129:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d43f5e1/0x99260d7389c070b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.219148:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d43f5e1/0x99260d7389c070b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.219161:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d43f5e1/0x99260d7389c070b2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.219177:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d43f5e1/0x99260d7389c070b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.219191:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043123.219192:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043123.219194:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789043123.219612:0:15187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789043123.219619:0:15187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008948c6c4/0x99260d7389c070b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.219628:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1789043123.219631:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043123.219635:0:15187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008948c6c4/0x99260d7389c070b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.220784:0:15187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008948c6c4/0x99260d7389c070b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.220795:0:15187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008948c6c4/0x99260d7389c070b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.220813:0:15187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008948c6c4/0x99260d7389c070b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.220834:0:15187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789043123.220848:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789043123.220852:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008948c6c4/0x99260d7389c070b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.220859:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a413a1200 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789043123.220863:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008948c6c4/0x99260d7389c070b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.220871:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008948c6c4/0x99260d7389c070b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.220945:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008948c6c4/0x99260d7389c070b9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.220953:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008948c6c4/0x99260d7389c070b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.220970:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043123.220971:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043123.220973:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789043123.222306:0:15187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789043123.222324:0:15187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036985025/0x99260d7389c070c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.222338:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1789043123.222343:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043123.222347:0:15187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036985025/0x99260d7389c070c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.222358:0:15187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036985025/0x99260d7389c070c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.222367:0:15187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036985025/0x99260d7389c070c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.222375:0:15187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036985025/0x99260d7389c070c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.222390:0:15187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789043123.222400:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789043123.222405:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036985025/0x99260d7389c070c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.222413:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a413a0c00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789043123.222417:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036985025/0x99260d7389c070c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.222426:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036985025/0x99260d7389c070c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.222445:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036985025/0x99260d7389c070c0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.222452:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036985025/0x99260d7389c070c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.222468:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043123.222470:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043123.222471:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043123.222939:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789043123.222953:0:15187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789043123.222960:0:15187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce0c100b/0x99260d7389c070c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.222969:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1789043123.222972:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043123.222977:0:15187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce0c100b/0x99260d7389c070c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.222986:0:15187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce0c100b/0x99260d7389c070c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.222995:0:15187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce0c100b/0x99260d7389c070c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.223002:0:15187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce0c100b/0x99260d7389c070c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.225584:0:15187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789043123.226209:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789043123.226218:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce0c100b/0x99260d7389c070c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043123.226232:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a413a0e00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:1.0:1789043123.226236:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce0c100b/0x99260d7389c070c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043123.226248:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce0c100b/0x99260d7389c070c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043123.226269:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce0c100b/0x99260d7389c070c7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043123.226277:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce0c100b/0x99260d7389c070c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043123.226297:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043123.226299:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043123.226305:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789043123.226384:0:15187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789043123.226392:0:15187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075963653/0x99260d7389c070ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.226403:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1789043123.226408:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043123.226414:0:15187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075963653/0x99260d7389c070ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.226425:0:15187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075963653/0x99260d7389c070ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.226433:0:15187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075963653/0x99260d7389c070ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.226441:0:15187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075963653/0x99260d7389c070ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.231657:0:15187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789043123.232291:0:15187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789043123.232302:0:15187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000573b285c/0x99260d7389c070d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.232318:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1789043123.232331:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043123.232338:0:15187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000573b285c/0x99260d7389c070d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.232352:0:15187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000573b285c/0x99260d7389c070d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.232362:0:15187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000573b285c/0x99260d7389c070d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.232370:0:15187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000573b285c/0x99260d7389c070d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789043123.233320:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:1.0:1789043123.235484:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789043123.235499:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075963653/0x99260d7389c070ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043123.235874:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a413a0200 already unused, calling callback (ffffffffc1470760) 00010000:00010000:1.0:1789043123.235880:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075963653/0x99260d7389c070ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043123.235892:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075963653/0x99260d7389c070ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043123.235914:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075963653/0x99260d7389c070ce lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043123.235923:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075963653/0x99260d7389c070ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043123.236018:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789043123.236023:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000573b285c/0x99260d7389c070d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043123.236031:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a413a0800 already unused, calling callback (ffffffffc1470760) 00010000:00010000:1.0:1789043123.236034:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000573b285c/0x99260d7389c070d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043123.236043:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000573b285c/0x99260d7389c070d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043123.236079:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000573b285c/0x99260d7389c070d5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043123.236088:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043123.236090:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043123.236092:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043123.236477:0:15187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789043123.236487:0:15187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000573b285c/0x99260d7389c070d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043123.236708:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789043123.240012:0:15187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789043123.240028:0:15187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dc47374/0x99260d7389c070dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.240045:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1789043123.240050:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043123.240056:0:15187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004dc47374/0x99260d7389c070dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.240068:0:15187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004dc47374/0x99260d7389c070dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.240086:0:15187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dc47374/0x99260d7389c070dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.240093:0:15187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004dc47374/0x99260d7389c070dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.240115:0:15187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789043123.240629:0:15187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789043123.240636:0:15187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fbae420/0x99260d7389c070e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.240645:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1789043123.240649:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043123.240653:0:15187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fbae420/0x99260d7389c070e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.240663:0:15187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fbae420/0x99260d7389c070e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.240672:0:15187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fbae420/0x99260d7389c070e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.240680:0:15187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fbae420/0x99260d7389c070e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.240712:0:15187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789043123.240728:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789043123.240735:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004dc47374/0x99260d7389c070dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.240743:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a413a0600 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789043123.240747:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004dc47374/0x99260d7389c070dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.240755:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004dc47374/0x99260d7389c070dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.240771:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004dc47374/0x99260d7389c070dc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.240779:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004dc47374/0x99260d7389c070dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.240797:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789043123.240801:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fbae420/0x99260d7389c070e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.240808:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa069418ad000 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789043123.240811:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fbae420/0x99260d7389c070e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.240830:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fbae420/0x99260d7389c070e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.240842:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fbae420/0x99260d7389c070e3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.240850:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fbae420/0x99260d7389c070e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.240863:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043123.240864:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043123.240867:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789043123.241281:0:15187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789043123.241288:0:15187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a4e4edb/0x99260d7389c070ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.241297:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1789043123.241301:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043123.241305:0:15187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a4e4edb/0x99260d7389c070ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.241315:0:15187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a4e4edb/0x99260d7389c070ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.241323:0:15187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a4e4edb/0x99260d7389c070ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.241337:0:15187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a4e4edb/0x99260d7389c070ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.241351:0:15187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789043123.241361:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789043123.241364:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a4e4edb/0x99260d7389c070ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.241371:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa069418ac400 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789043123.241374:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a4e4edb/0x99260d7389c070ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.241381:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a4e4edb/0x99260d7389c070ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.241392:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a4e4edb/0x99260d7389c070ea lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.241399:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a4e4edb/0x99260d7389c070ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.241411:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043123.241412:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043123.241413:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789043123.241819:0:15187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789043123.241832:0:15187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a1528d5/0x99260d7389c070f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.241842:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1789043123.241845:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043123.241849:0:15187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a1528d5/0x99260d7389c070f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.241858:0:15187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a1528d5/0x99260d7389c070f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.241866:0:15187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a1528d5/0x99260d7389c070f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.241873:0:15187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a1528d5/0x99260d7389c070f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.241888:0:15187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789043123.241896:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789043123.241900:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a1528d5/0x99260d7389c070f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.241906:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa069418ac200 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789043123.241909:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1528d5/0x99260d7389c070f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.241916:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1528d5/0x99260d7389c070f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.241933:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a1528d5/0x99260d7389c070f1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.241940:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a1528d5/0x99260d7389c070f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.241954:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043123.241956:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043123.241958:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789043123.242354:0:15187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789043123.242361:0:15187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bc5f77d/0x99260d7389c070f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.242370:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1789043123.242373:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043123.242377:0:15187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bc5f77d/0x99260d7389c070f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.242385:0:15187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bc5f77d/0x99260d7389c070f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.242394:0:15187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bc5f77d/0x99260d7389c070f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.242402:0:15187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bc5f77d/0x99260d7389c070f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.242427:0:15187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789043123.242436:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789043123.242440:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bc5f77d/0x99260d7389c070f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.242446:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa069418acc00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789043123.242449:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bc5f77d/0x99260d7389c070f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.242457:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bc5f77d/0x99260d7389c070f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.242469:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bc5f77d/0x99260d7389c070f8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.242477:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bc5f77d/0x99260d7389c070f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.242491:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043123.242492:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043123.242494:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789043123.242906:0:15187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789043123.242912:0:15187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0bc9fd9/0x99260d7389c070ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.242921:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1789043123.242930:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043123.242934:0:15187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0bc9fd9/0x99260d7389c070ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.242943:0:15187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0bc9fd9/0x99260d7389c070ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.242951:0:15187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0bc9fd9/0x99260d7389c070ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.242957:0:15187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0bc9fd9/0x99260d7389c070ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.242973:0:15187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789043123.242982:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789043123.242986:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0bc9fd9/0x99260d7389c070ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.242994:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa069418ad200 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789043123.242997:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0bc9fd9/0x99260d7389c070ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.243005:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0bc9fd9/0x99260d7389c070ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.243017:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0bc9fd9/0x99260d7389c070ff lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.243035:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0bc9fd9/0x99260d7389c070ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.243049:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043123.243051:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043123.243053:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043123.243455:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789043123.250939:0:15187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789043123.251085:0:15187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e47bbb4b/0x99260d7389c07106 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.251102:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1789043123.251107:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043123.251113:0:15187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e47bbb4b/0x99260d7389c07106 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.251127:0:15187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e47bbb4b/0x99260d7389c07106 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.251138:0:15187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e47bbb4b/0x99260d7389c07106 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.251145:0:15187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e47bbb4b/0x99260d7389c07106 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.251174:0:15187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789043123.251865:0:15187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789043123.251880:0:15187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9f2e4ec/0x99260d7389c0710d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.251890:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1789043123.251893:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043123.251898:0:15187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9f2e4ec/0x99260d7389c0710d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.251908:0:15187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9f2e4ec/0x99260d7389c0710d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.251918:0:15187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9f2e4ec/0x99260d7389c0710d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.251924:0:15187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9f2e4ec/0x99260d7389c0710d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.252018:0:15187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789043123.252741:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789043123.252751:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e47bbb4b/0x99260d7389c07106 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043123.252761:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa069418aca00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:2.0:1789043123.252766:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e47bbb4b/0x99260d7389c07106 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043123.252776:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e47bbb4b/0x99260d7389c07106 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043123.252795:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e47bbb4b/0x99260d7389c07106 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043123.252810:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e47bbb4b/0x99260d7389c07106 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043123.252832:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789043123.252835:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9f2e4ec/0x99260d7389c0710d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043123.252841:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa069418ac800 already unused, calling callback (ffffffffc1470760) 00010000:00010000:2.0:1789043123.252844:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9f2e4ec/0x99260d7389c0710d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043123.252851:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9f2e4ec/0x99260d7389c0710d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043123.252861:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9f2e4ec/0x99260d7389c0710d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043123.252868:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9f2e4ec/0x99260d7389c0710d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043123.252879:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043123.252881:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043123.252882:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043123.253377:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789043123.259489:0:15187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789043123.259504:0:15187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be45d300/0x99260d7389c07114 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043123.259579:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=466s v=(0 0) 00010000:00010000:3.0:1789043123.259584:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789043123.259591:0:15187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be45d300/0x99260d7389c07114 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043123.259606:0:15187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be45d300/0x99260d7389c07114 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043123.259616:0:15187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be45d300/0x99260d7389c07114 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043123.259623:0:15187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be45d300/0x99260d7389c07114 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043123.259652:0:15187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789043123.260275:0:15187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789043123.260282:0:15187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eacd1f76/0x99260d7389c0711b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043123.260304:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=466s v=(0 0) 00010000:00010000:3.0:1789043123.260307:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789043123.260312:0:15187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eacd1f76/0x99260d7389c0711b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043123.260321:0:15187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eacd1f76/0x99260d7389c0711b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043123.260329:0:15187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eacd1f76/0x99260d7389c0711b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043123.260336:0:15187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eacd1f76/0x99260d7389c0711b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043123.260356:0:15187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789043123.260371:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789043123.260377:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be45d300/0x99260d7389c07114 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043123.260385:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc28000 already unused, calling callback (ffffffffc1470760) 00010000:00010000:3.0:1789043123.260389:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be45d300/0x99260d7389c07114 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043123.260398:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be45d300/0x99260d7389c07114 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043123.260430:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be45d300/0x99260d7389c07114 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043123.260438:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be45d300/0x99260d7389c07114 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043123.260457:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789043123.260460:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eacd1f76/0x99260d7389c0711b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043123.260467:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc28e00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:3.0:1789043123.260470:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eacd1f76/0x99260d7389c0711b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043123.260477:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eacd1f76/0x99260d7389c0711b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043123.260486:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eacd1f76/0x99260d7389c0711b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043123.260493:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eacd1f76/0x99260d7389c0711b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043123.260505:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043123.260507:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043123.260541:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043123.260764:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789043123.261814:0:15187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789043123.261824:0:15187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0bc9fd9/0x99260d7389c07122 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.261837:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1789043123.261841:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043123.261846:0:15187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0bc9fd9/0x99260d7389c07122 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.261870:0:15187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0bc9fd9/0x99260d7389c07122 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.261880:0:15187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0bc9fd9/0x99260d7389c07122 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.261888:0:15187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0bc9fd9/0x99260d7389c07122 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.261942:0:15187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789043123.262386:0:15187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789043123.262393:0:15187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bc5f77d/0x99260d7389c07129 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.262402:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1789043123.262405:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043123.262410:0:15187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bc5f77d/0x99260d7389c07129 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.262420:0:15187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bc5f77d/0x99260d7389c07129 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.262428:0:15187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bc5f77d/0x99260d7389c07129 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.262447:0:15187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bc5f77d/0x99260d7389c07129 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043123.265875:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789043123.265890:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0bc9fd9/0x99260d7389c07122 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043123.265903:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa069418ad200 already unused, calling callback (ffffffffc1470760) 00010000:00010000:3.0:1789043123.265909:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0bc9fd9/0x99260d7389c07122 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043123.265920:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0bc9fd9/0x99260d7389c07122 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043123.265951:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0bc9fd9/0x99260d7389c07122 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043123.265960:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0bc9fd9/0x99260d7389c07122 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043123.265980:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789043123.265984:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bc5f77d/0x99260d7389c07129 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043123.265990:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa069418acc00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:3.0:1789043123.265994:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bc5f77d/0x99260d7389c07129 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043123.266002:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bc5f77d/0x99260d7389c07129 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043123.266020:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bc5f77d/0x99260d7389c07129 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043123.266029:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043123.266031:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043123.266033:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043123.267021:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043123.267060:0:15187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789043123.267070:0:15187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bc5f77d/0x99260d7389c07129 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789043123.268074:0:15187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789043123.268083:0:15187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a1528d5/0x99260d7389c07130 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.268099:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1789043123.268103:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043123.268110:0:15187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a1528d5/0x99260d7389c07130 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.268123:0:15187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a1528d5/0x99260d7389c07130 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.268133:0:15187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a1528d5/0x99260d7389c07130 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.268142:0:15187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a1528d5/0x99260d7389c07130 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043123.268224:0:15187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1789043123.268426:0:15187:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:0.0:1789043123.268609:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14524:x1875947267655680:12345-0@lo:5:osp-pre-0-0.0 Request processed in 68414us (68510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043123.268620:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789043123.268800:0:14524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767e8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14524:1875947267655680:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789043123.268825:0:14524:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:2.0:1789043123.268876:0:14524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14524:1875947267655808:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789043123.268913:0:14524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043123.268963:0:14524:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a50a62cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789043123.270857:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267655808 00000100:00100000:0.0:1789043123.270871:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267655808 00000100:00100000:0.0:1789043123.270927:0:15188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789043123.270937:0:15188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14524:x1875947267655808:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1789043123.271003:0:15188:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:3.0:1789043123.272885:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789043123.272899:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a1528d5/0x99260d7389c07130 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043123.272912:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa069418ac200 already unused, calling callback (ffffffffc1470760) 00010000:00010000:3.0:1789043123.272916:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1528d5/0x99260d7389c07130 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043123.272928:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1528d5/0x99260d7389c07130 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043123.272959:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a1528d5/0x99260d7389c07130 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043123.272967:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a1528d5/0x99260d7389c07130 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043123.278734:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043123.278740:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043123.278743:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789043123.284075:0:15188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14524:x1875947267655808:12345-0@lo:5:osp-pre-0-0.0 Request processed in 13130us (15152us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789043123.284089:0:15188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789043123.286862:0:14524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14524:1875947267655808:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789043123.286883:0:14524:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:1.0:1789043123.828983:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043124.852212:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789043125.145691:0:15901:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789043125.145696:0:15901:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1789043125.145916:0:15901:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa06a75ed5800 00000020:01000004:1.0:1789043125.145932:0:15901:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789043125.145945:0:15901:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1789043125.145958:0:15901:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0001-osd (ffffa06a5209b3b0) 00000020:00000080:1.0:1789043125.145974:0:15901:0:(obd_config.c:786:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789043125.165436:0:15901:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789043125.166043:0:15901:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789043125.167290:0:15901:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789043125.167918:0:15901:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789043125.173055:0:15901:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789043125.173570:0:15901:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 429: rc = 0 00100000:10000000:2.0:1789043125.174105:0:15901:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 429: rc = 0 00100000:10000000:2.0:1789043125.174219:0:15901:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 429: rc = 0 00100000:10000000:2.0:1789043125.175112:0:15901:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 462: rc = 0 00100000:10000000:2.0:1789043125.175375:0:15901:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 462: rc = 0 00100000:10000000:2.0:1789043125.178187:0:15901:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 462: rc = 0 00100000:10000000:2.0:1789043125.178606:0:15901:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 462: rc = 0 00100000:10000000:2.0:1789043125.180727:0:15901:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 462: rc = 0 00100000:10000000:2.0:1789043125.181082:0:15901:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 462: rc = 0 00000020:00000080:2.0:1789043125.183423:0:15901:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789043125.183437:0:15901:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789043125.183450:0:15901:0:(genops.c:1393:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x99260d7389c0713e 00000020:01000004:2.0:1789043125.183459:0:15901:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789043125.183480:0:15901:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.117@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789043125.183484:0:15901:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.117@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789043125.183491:0:15901:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789043125.183553:0:15901:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789043125.183570:0:15901:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.117@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789043125.194024:0:15901:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.117@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789043125.194070:0:15901:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.117@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1789043125.194074:0:15901:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789043125.194076:0:15901:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789043125.194077:0:15901:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789043125.194079:0:15901:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789043125.194080:0:15901:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789043125.194081:0:15901:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789043125.194083:0:15901:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789043125.194085:0:15901:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789043125.194086:0:15901:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789043125.194089:0:15901:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1789043125.194092:0:15901:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789043125.194093:0:15901:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789043125.194094:0:15901:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789043125.194095:0:15901:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789043125.194096:0:15901:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789043125.194097:0:15901:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789043125.194099:0:15901:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789043125.194100:0:15901:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789043125.194101:0:15901:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789043125.194126:0:15901:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789043125.194148:0:15901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a024700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15901:1875947267655936:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789043125.194354:0:15901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043125.194501:0:15901:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7726ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789043125.194832:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267655936 00000100:00100000:1.0:1789043125.194841:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267655936 00000100:00100000:1.0:1789043125.194932:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789043125.194942:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7659bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+16:15901:x1875947267655936:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789043125.194985:0:14493:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789043125.194988:0:14493:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1789043125.194992:0:14493:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789043125.206987:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7659bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+16:15901:x1875947267655936:12345-0@lo:253:mount.lustre.0 Request processed in 12039us (12625us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043125.207000:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789043125.207101:0:15901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a024700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15901:1875947267655936:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789043125.207116:0:15901:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789043125.207138:0:15901:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789043125.207140:0:15901:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789043125.207142:0:15901:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789043125.207143:0:15901:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789043125.207144:0:15901:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789043125.207146:0:15901:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789043125.207147:0:15901:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789043125.207159:0:15901:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789043125.207161:0:15901:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789043125.207181:0:15901:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa06a75ed5800 from lustre-OST0001 10000000:01000000:1.0:1789043125.207269:0:15901:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789043125.207272:0:15901:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789043125.207343:0:15901:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa06a7fae4d88 local copy 00010000:00010000:1.0:1789043125.207355:0:15901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6fa00/0x99260d7389c06ee4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06eeb expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043125.207803:0:15901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edb9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15901:1875947267656064:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789043125.207841:0:15901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043125.207873:0:15901:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a76602b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789043125.208022:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267656064 00000100:00100000:3.0:1789043125.208029:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267656064 00000100:00100000:3.0:1789043125.208073:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789043125.208082:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5244b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+16:15901:x1875947267656064:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789043125.209005:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5244b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+16:15901:x1875947267656064:12345-0@lo:501:mount.lustre.0 Request processed in 922us (1160us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789043125.209022:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789043125.209146:0:15901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edb9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15901:1875947267656064:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789043125.209179:0:15901:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.117@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789043125.209603:0:15901:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.117@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789043125.209612:0:15901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6fa00/0x99260d7389c06ee4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06eeb expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043125.209623:0:15901:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6fa00/0x99260d7389c06ee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c06eeb expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789043125.209713:0:15901:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa06a75ed5800 10000000:01000000:1.0:1789043125.209718:0:15901:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789043125.209723:0:15901:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789043125.209732:0:15901:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789043125.209737:0:15901:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789043125.209740:0:15901:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789043125.209766:0:15901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41687800/0x99260d7389c07145 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043125.209775:0:15901:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a41687800/0x99260d7389c07145 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043125.209785:0:15901:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a41687800/0x99260d7389c07145 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043125.209801:0:15901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edb9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15901:1875947267656192:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789043125.209834:0:15901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043125.209863:0:15901:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a76602b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789043125.210032:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267656192 00000100:00100000:3.0:1789043125.210039:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267656192 00000100:00100000:3.0:1789043125.210080:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789043125.210089:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+16:15901:x1875947267656192:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789043125.210099:0:14493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789043125.210111:0:14493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a6fc29800/0x99260d7389c0714c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c07145 expref: -99 pid: 14493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043125.210133:0:14493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a6fc29800/0x99260d7389c0714c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c07145 expref: 17 pid: 14493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043125.210144:0:14493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a6fc29800/0x99260d7389c0714c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c07145 expref: 17 pid: 14493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043125.210163:0:14493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc29800, rc 0) 00000100:00100000:3.0:1789043125.210204:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+17:15901:x1875947267656192:12345-0@lo:101:mount.lustre.0 Request processed in 116us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043125.210210:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789043125.210510:0:15901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edb9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15901:1875947267656192:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789043125.210546:0:15901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a41687800/0x99260d7389c07145 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c0714c expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043125.210555:0:15901:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a41687800/0x99260d7389c07145 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c0714c expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789043125.212024:0:15901:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1789043125.213463:0:15901:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789043125.213938:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1789043125.213984:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1789043125.214018:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1789043125.214067:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1789043125.214105:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1789043125.214136:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1789043125.214359:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1789043125.214367:0:15901:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1789043125.214448:0:15901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edb9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15901:1875947267656320:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789043125.214724:0:15901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043125.214856:0:15901:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a76602540 going to sleep for 11 seconds 00000100:00100000:3.0:1789043125.215275:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267656320 00000100:00100000:3.0:1789043125.215290:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267656320 00000100:00100000:3.0:1789043125.215385:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789043125.215395:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+17:15901:x1875947267656320:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789043125.215806:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+17:15901:x1875947267656320:12345-0@lo:501:mount.lustre.0 Request processed in 412us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043125.215815:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789043125.215908:0:15901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edb9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15901:1875947267656320:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789043125.215964:0:15901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15901:1875947267656448:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789043125.216008:0:15901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043125.216326:0:15901:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a42ebfb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789043125.216473:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267656448 00000100:00100000:1.0:1789043125.216478:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267656448 00000100:00100000:1.0:1789043125.216508:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789043125.216529:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+17:15901:x1875947267656448:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789043125.216899:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+17:15901:x1875947267656448:12345-0@lo:503:mount.lustre.0 Request processed in 383us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043125.216907:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789043125.216921:0:15901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15901:1875947267656448:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789043125.218118:0:15901:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789043125.218204:0:15901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a024e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15901:1875947267656576:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789043125.218260:0:15901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043125.218300:0:15901:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7726c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789043125.218375:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267656576 00000100:00100000:0.0:1789043125.218382:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267656576 00000100:00100000:0.0:1789043125.218420:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789043125.218429:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+17:15901:x1875947267656576:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789043125.218970:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+17:15901:x1875947267656576:12345-0@lo:502:mount.lustre.0 Request processed in 541us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043125.218975:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789043125.219042:0:15901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a024e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15901:1875947267656576:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789043125.219300:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789043125.219348:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789043125.219447:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789043125.219500:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789043125.219864:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789043125.219904:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789043125.219956:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789043125.219978:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789043125.220002:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1789043125.220029:0:15901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a024e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15901:1875947267656704:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789043125.220071:0:15901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043125.220101:0:15901:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7726c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789043125.220227:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267656704 00000100:00100000:1.0:1789043125.220233:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267656704 00000100:00100000:1.0:1789043125.220264:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789043125.220272:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52449450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+17:15901:x1875947267656704:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789043125.220921:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52449450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+17:15901:x1875947267656704:12345-0@lo:502:mount.lustre.0 Request processed in 648us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043125.220929:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789043125.221059:0:15901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a024e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15901:1875947267656704:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789043125.221171:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1789043125.221183:0:15901:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1789043125.223490:0:15902:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789043125.223503:0:15902:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1789043125.223510:0:15902:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789043125.223650:0:15902:0:(obd_config.c:1661:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789043125.223660:0:15902:0:(obd_config.c:1570:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789043125.223675:0:15902:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0001 (ffffa06a47344d88) 00000020:00000080:0.0:1789043125.223696:0:15902:0:(obd_config.c:786:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789043125.223702:0:15902:0:(obd_config.c:1570:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789043125.223834:0:15902:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa06a75ed5800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789043125.223845:0:15902:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789043125.223862:0:15902:0:(genops.c:1393:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x99260d7389c0715a 00010000:00010000:2.0:1789043125.232205:0:15902:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1789043125.232759:0:15902:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1789043125.238744:0:15902:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1789043125.244713:0:15902:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789043125.244727:0:15902:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789043125.244734:0:15902:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789043125.244737:0:15902:0:(obd_config.c:1661:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789043125.244741:0:15902:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789043125.244746:0:15902:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789043125.244747:0:15902:0:(obd_config.c:1661:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789043125.244750:0:15902:0:(obd_config.c:1570:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789043125.244752:0:15902:0:(obd_config.c:1635:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789043125.244754:0:15902:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789043125.244764:0:15902:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789043125.244765:0:15902:0:(obd_config.c:1661:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789043125.244769:0:15902:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789043125.244772:0:15902:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789043125.244773:0:15902:0:(obd_config.c:1661:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789043125.244776:0:15902:0:(obd_config.c:1570:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789043125.244837:0:15902:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789043125.244841:0:15902:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789043125.244843:0:15902:0:(obd_config.c:1661:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789043125.244846:0:15902:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1789043125.245130:0:15901:0:(obd_config.c:2243:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1789043125.245167:0:15901:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789043125.245193:0:15901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41687800/0x99260d7389c07145 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c0714c expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043125.245205:0:15901:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a41687800/0x99260d7389c07145 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c0714c expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789043125.245214:0:15901:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa06a75ed5800 from 1 10000000:01000000:2.0:1789043125.245217:0:15901:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789043125.245252:0:15901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a50978e00/0x99260d7389c07161 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043125.245260:0:15901:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a50978e00/0x99260d7389c07161 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043125.245271:0:15901:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a50978e00/0x99260d7389c07161 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043125.245300:0:15901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15901:1875947267656832:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789043125.245360:0:15901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043125.245401:0:15901:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a6ecd0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789043125.245449:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267656832 00000100:00100000:0.0:1789043125.245456:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267656832 00000100:00100000:0.0:1789043125.245502:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789043125.245528:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+17:15901:x1875947267656832:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789043125.245541:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789043125.245553:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa069418ad000/0x99260d7389c07168 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c07161 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043125.245575:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa069418ad000/0x99260d7389c07168 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c07161 expref: 18 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043125.245585:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa069418ad000/0x99260d7389c07168 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c07161 expref: 18 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043125.245594:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa069418ad000, rc 0) 00000100:00100000:0.0:1789043125.245705:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+18:15901:x1875947267656832:12345-0@lo:101:mount.lustre.0 Request processed in 194us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043125.245712:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789043125.245734:0:15901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15901:1875947267656832:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789043125.245748:0:15901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a50978e00/0x99260d7389c07161 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c07168 expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043125.245757:0:15901:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a50978e00/0x99260d7389c07161 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c07168 expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789043125.246256:0:15901:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1789043125.247139:0:15901:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789043125.247401:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789043125.247446:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789043125.248768:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789043125.248782:0:15901:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789043125.248868:0:15901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edb8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15901:1875947267656960:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789043125.248926:0:15901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043125.253112:0:15901:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a76602e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789043125.253248:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267656960 00000100:00100000:0.0:1789043125.253259:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267656960 00000100:00100000:0.0:1789043125.256295:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789043125.256460:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5244b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+18:15901:x1875947267656960:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789043125.258335:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5244b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+18:15901:x1875947267656960:12345-0@lo:501:mount.lustre.0 Request processed in 2022us (9402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043125.258348:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789043125.258707:0:15901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edb8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15901:1875947267656960:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789043125.258761:0:15901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edb8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15901:1875947267657088:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789043125.258808:0:15901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043125.258860:0:15901:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a76602e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789043125.258990:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267657088 00000100:00100000:0.0:1789043125.258997:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267657088 00000100:00100000:0.0:1789043125.259055:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789043125.259075:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+18:15901:x1875947267657088:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789043125.259256:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+18:15901:x1875947267657088:12345-0@lo:503:mount.lustre.0 Request processed in 192us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043125.259268:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789043125.259346:0:15901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edb8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15901:1875947267657088:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789043125.259871:0:15901:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789043125.259949:0:15901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edb8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15901:1875947267657216:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789043125.259988:0:15901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043125.260026:0:15901:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a76602e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789043125.260102:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267657216 00000100:00100000:0.0:1789043125.260108:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267657216 00000100:00100000:0.0:1789043125.260148:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789043125.260166:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43884c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+18:15901:x1875947267657216:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789043125.260322:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43884c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+18:15901:x1875947267657216:12345-0@lo:502:mount.lustre.0 Request processed in 157us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043125.260328:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789043125.260465:0:15901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edb8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15901:1875947267657216:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789043125.260781:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789043125.260851:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789043125.260940:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789043125.261005:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789043125.261741:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789043125.261802:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789043125.261839:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789043125.261892:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1789043125.261928:0:15901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edb8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15901:1875947267657344:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789043125.261984:0:15901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043125.262031:0:15901:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a76602e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789043125.262722:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267657344 00000100:00100000:0.0:1789043125.262730:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267657344 00000100:00100000:0.0:1789043125.262780:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789043125.262789:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43887c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+18:15901:x1875947267657344:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789043125.262979:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43887c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+18:15901:x1875947267657344:12345-0@lo:502:mount.lustre.0 Request processed in 190us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043125.262987:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789043125.263093:0:15901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edb8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15901:1875947267657344:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789043125.263218:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1789043125.263231:0:15901:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1789043125.267798:0:15906:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789043125.267813:0:15906:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789043125.267815:0:15906:0:(obd_config.c:1661:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789043125.267823:0:15906:0:(obd_config.c:2102:class_config_llog_handler()) cmd ce032, instance name: general-ffffa06a75ed5800 00000020:00000080:3.0:1789043125.267825:0:15906:0:(obd_config.c:1570:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789043125.267832:0:15906:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789043125.267835:0:15906:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789043125.267836:0:15906:0:(obd_config.c:1661:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789043125.267848:0:15906:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789043125.267850:0:15906:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789043125.267852:0:15906:0:(obd_config.c:1661:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789043125.267855:0:15906:0:(obd_config.c:2102:class_config_llog_handler()) cmd ce032, instance name: general-ffffa06a75ed5800 00000020:00000080:3.0:1789043125.267857:0:15906:0:(obd_config.c:1570:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789043125.268054:0:15906:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789043125.268058:0:15906:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789043125.268060:0:15906:0:(obd_config.c:1661:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789043125.268062:0:15906:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789043125.268065:0:15906:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789043125.268066:0:15906:0:(obd_config.c:1661:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789043125.268070:0:15906:0:(obd_config.c:2102:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa06a75ed5800 00000020:00000080:3.0:1789043125.268072:0:15906:0:(obd_config.c:1570:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789043125.275299:0:15906:0:(obd_config.c:1991:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789043125.275311:0:15906:0:(obd_config.c:1570:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789043125.275313:0:15906:0:(obd_config.c:1661:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789043125.275317:0:15906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1789043125.282296:0:15901:0:(obd_config.c:2243:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1789043125.282336:0:15901:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789043125.282361:0:15901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a50978e00/0x99260d7389c07161 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c07168 expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043125.282374:0:15901:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a50978e00/0x99260d7389c07161 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c07168 expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789043125.282434:0:15901:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789043125.282437:0:15901:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa06a75ed5800 10000000:01000000:1.0:1789043125.282440:0:15901:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa06a75ed5800 10000000:01000000:1.0:1789043125.282445:0:15901:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789043125.282451:0:15901:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa06a75ed5800 from 1 10000000:01000000:1.0:1789043125.282454:0:15901:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789043125.282700:0:15901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41687a00/0x99260d7389c0716f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043125.282710:0:15901:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a41687a00/0x99260d7389c0716f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043125.282721:0:15901:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a41687a00/0x99260d7389c0716f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043125.282748:0:15901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edb8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15901:1875947267657472:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789043125.282811:0:15901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043125.282853:0:15901:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a55c063c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789043125.283570:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267657472 00000100:00100000:2.0:1789043125.283580:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267657472 00000100:00100000:2.0:1789043125.283639:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789043125.283649:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43886c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+18:15901:x1875947267657472:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789043125.283664:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043125.283678:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a50978000/0x99260d7389c07176 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c0716f expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043125.283706:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a50978000/0x99260d7389c07176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c0716f expref: 19 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043125.283716:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a50978000/0x99260d7389c07176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c0716f expref: 19 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043125.283723:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a50978000, rc 0) 00000100:00100000:2.0:1789043125.283778:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43886c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+19:15901:x1875947267657472:12345-0@lo:101:mount.lustre.0 Request processed in 130us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043125.283784:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789043125.285608:0:15901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edb8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15901:1875947267657472:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789043125.285643:0:15901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a41687a00/0x99260d7389c0716f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c07176 expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043125.285655:0:15901:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a41687a00/0x99260d7389c0716f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c07176 expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789043125.286685:0:15901:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1789043125.287000:0:15901:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789043125.287679:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789043125.287743:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789043125.287773:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789043125.287810:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789043125.287835:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789043125.287868:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789043125.287952:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789043125.287989:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789043125.288020:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789043125.288039:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789043125.288058:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789043125.288102:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789043125.288123:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789043125.288146:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789043125.288296:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789043125.288356:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789043125.288423:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789043125.288503:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789043125.288810:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789043125.288845:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789043125.288904:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789043125.288946:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789043125.288981:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789043125.289029:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789043125.289068:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1789043125.289104:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1789043125.289451:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1789043125.289512:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1789043125.289776:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1789043125.289833:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1789043125.289873:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1789043125.289990:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1789043125.290028:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1789043125.290077:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1789043125.290127:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1789043125.290274:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1789043125.290320:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1789043125.290480:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1789043125.290487:0:15901:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1789043125.290596:0:15901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edb8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15901:1875947267657600:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789043125.290794:0:15901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043125.290848:0:15901:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a55c063c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789043125.291194:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267657600 00000100:00100000:3.0:1789043125.291203:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267657600 00000100:00100000:3.0:1789043125.291260:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789043125.291270:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43884050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+19:15901:x1875947267657600:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789043125.291500:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43884050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+19:15901:x1875947267657600:12345-0@lo:501:mount.lustre.0 Request processed in 231us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043125.291508:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789043125.294746:0:15901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edb8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15901:1875947267657600:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789043125.294809:0:15901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edb8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15901:1875947267657728:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789043125.294886:0:15901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043125.294928:0:15901:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a55c063c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789043125.294991:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267657728 00000100:00100000:3.0:1789043125.294999:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267657728 00000100:00100000:3.0:1789043125.295054:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789043125.295064:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a43884850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+19:15901:x1875947267657728:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789043125.295265:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a43884850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+19:15901:x1875947267657728:12345-0@lo:503:mount.lustre.0 Request processed in 202us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043125.295281:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789043125.295493:0:15901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edb8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15901:1875947267657728:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789043125.296325:0:15901:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789043125.296498:0:15901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edbb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15901:1875947267657856:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789043125.296587:0:15901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043125.296622:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267657856 00000100:00100000:1.0:1789043125.296628:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267657856 00000100:00100000:1.0:1789043125.296745:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789043125.296755:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f908c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+19:15901:x1875947267657856:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789043125.297109:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f908c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+19:15901:x1875947267657856:12345-0@lo:502:mount.lustre.0 Request processed in 355us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043125.297117:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789043125.297177:0:15901:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a44dda240 going to sleep for 11 seconds 00000100:00100000:1.0:1789043125.297192:0:15901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edbb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15901:1875947267657856:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789043125.297453:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789043125.297503:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789043125.297579:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789043125.297624:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789043125.297661:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789043125.297725:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789043125.297782:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789043125.297821:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789043125.297870:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789043125.297924:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789043125.297959:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789043125.298009:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789043125.298411:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789043125.298461:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789043125.298564:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789043125.298607:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789043125.298646:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789043125.298708:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789043125.299943:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789043125.300106:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789043125.300184:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789043125.300316:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789043125.300360:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789043125.300418:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789043125.300468:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1789043125.300507:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1789043125.300590:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1789043125.300644:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1789043125.300683:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1789043125.300733:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1789043125.301733:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1789043125.301806:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1789043125.301833:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1789043125.302105:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1789043125.302174:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1789043125.302237:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1789043125.302273:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1789043125.302307:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1789043125.302352:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1789043125.302388:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1789043125.302438:0:15901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edbb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15901:1875947267657984:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789043125.302546:0:15901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043125.302599:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267657984 00000100:00100000:1.0:1789043125.302607:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267657984 00000100:00100000:1.0:1789043125.302661:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789043125.302673:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f908050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+19:15901:x1875947267657984:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789043125.304330:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f908050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+19:15901:x1875947267657984:12345-0@lo:502:mount.lustre.0 Request processed in 1653us (1780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043125.304344:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789043125.304441:0:15901:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a467b4900 going to sleep for 11 seconds 00000100:00100000:1.0:1789043125.304469:0:15901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edbb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15901:1875947267657984:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789043125.304617:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1789043125.304638:0:15901:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1789043125.307303:0:15911:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789043125.307323:0:15911:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffffa06a52098000) 00000020:00000080:1.0:1789043125.307347:0:15911:0:(obd_config.c:786:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1789043125.307421:0:15911:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa06a75ed5800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789043125.307426:0:15911:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa06a75ed5800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789043125.307428:0:15911:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa06a75ed5800 3 00010000:00080000:1.0:1789043125.307475:0:15911:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa06a763b9000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.117@tcp at head 00010000:00010000:1.0:1789043125.313654:0:15911:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1789043125.313873:0:15911:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789043125.313926:0:15911:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789043125.313954:0:15911:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x99260d7389c07184 00000100:00080000:1.0:1789043125.313965:0:15911:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789043125.313971:0:15911:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa06a763b9000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:1.0:1789043125.314004:0:15911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa06a6edbb100 x1875947267658112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789043125.314047:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875947267658112:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789043125.314112:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789043125.314176:0:15911:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789043125.314233:0:470:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789043125.314237:0:470:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789043125.314239:0:470:0:(import.c:65:import_set_state_nolock()) ffffa06a7730f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789043125.314244:0:470:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 466 00000100:00080000:1.0:1789043125.314248:0:470:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789043125.314252:0:470:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa06a7730f000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:1.0:1789043125.314265:0:470:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa06a6edb8e00 x1875947267658368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789043125.314315:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267658240:0@lo:400:kworker.0 00000100:00100000:1.0:1789043125.314345:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043125.314368:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789043125.314373:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267658496:0@lo:400:kworker.0 00000100:00100000:1.0:1789043125.314398:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043125.314424:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875947267658624:0@lo:400:kworker.0 00000100:00100000:1.0:1789043125.314449:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043125.314485:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267658240 00000100:00100000:1.0:1789043125.314492:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267658240 00000100:00100000:1.0:1789043125.314574:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789043125.314586:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6edb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3314:x1875947267658240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789043125.314589:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267658112 00000100:00100000:0.0:1789043125.314596:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267658112 00000100:00100000:0.0:1789043125.314619:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267658496 00000100:00100000:0.0:1789043125.314623:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267658496 00000100:00100000:1.0:1789043125.314640:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6edb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3314:x1875947267658240:12345-0@lo:400:kworker.0 Request processed in 57us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043125.314642:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267658624 00000100:00100000:0.0:1789043125.314647:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267658624 00000100:00100000:1.0:1789043125.314654:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789043125.314670:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789043125.314680:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6edba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267658496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789043125.314686:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789043125.314696:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6edbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875947267658624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789043125.314723:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6edba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875947267658496:12345-0@lo:400:kworker.0 Request processed in 45us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043125.314739:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789043125.314753:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789043125.314758:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6edb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3311:x1875947267658112:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789043125.314779:0:14502:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:0.0:1789043125.314808:0:14502:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x99260d7389c0718b 00000004:00100000:0.0:1789043125.314823:0:14502:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789043125.314853:0:14502:0:(import.c:65:import_set_state_nolock()) ffffa06a51cc1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789043125.314885:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6edb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875947267658112:12345-0@lo:38:llog_process_th.0 Request processed in 126us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043125.314892:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789043125.315316:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6edbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875947267658624:12345-0@lo:400:kworker.0 Request processed in 621us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043125.315325:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1789043125.315352:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789043125.315358:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789043125.315392:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a6edb9880 x1875947267658624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789043141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789043125.315405:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875947267658624:0@lo:400:kworker.0 00010000:00080000:1.0:1789043125.315438:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a6edbb480 x1875947267658496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789043141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789043125.315448:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875947267658496:0@lo:400:kworker.0 00000100:00100000:1.0:1789043125.315462:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267658240:0@lo:400:kworker.0 00000100:00100000:1.0:1789043125.315481:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875947267658368:0@lo:8:kworker.0 00000100:00100000:1.0:1789043125.315534:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789043125.315565:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa06a6edbb100 x1875947267658112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789043135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789043125.315574:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789043125.315588:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1789043125.315596:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789043125.315601:0:3311:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789043125.315604:0:3311:0:(import.c:65:import_set_state_nolock()) ffffa06a763b9000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789043125.315610:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875947267658112:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789043125.315636:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267658368 00000100:00100000:1.0:1789043125.315640:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267658368 00000100:00100000:1.0:1789043125.315663:0:15188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789043125.315669:0:15188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6edb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3311:x1875947267658368:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789043125.315715:0:15188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6edb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3311:x1875947267658368:12345-0@lo:8:kworker.0 Request processed in 45us (200us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789043125.315722:0:15188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789043125.315747:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789043125.315751:0:3311:0:(import.c:65:import_set_state_nolock()) ffffa06a7730f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789043125.315754:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789043125.315757:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875947267658368:0@lo:8:kworker.0 00000040:00080000:1.0:1789043125.321751:0:15911:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1789043125.321846:0:15901:0:(obd_config.c:2243:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789043125.321877:0:15901:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789043125.321904:0:15901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41687a00/0x99260d7389c0716f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c07176 expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043125.321926:0:15901:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a41687a00/0x99260d7389c0716f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c07176 expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789043125.321975:0:15901:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789043125.321977:0:15901:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789043125.321979:0:15901:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789043125.321980:0:15901:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789043125.321981:0:15901:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789043125.321983:0:15901:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789043125.321984:0:15901:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789043125.321986:0:15901:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789043125.321988:0:15901:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789043125.321992:0:15901:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1789043125.321994:0:15901:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789043125.321995:0:15901:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789043125.321996:0:15901:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789043125.321997:0:15901:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789043125.321999:0:15901:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789043125.322000:0:15901:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789043125.322001:0:15901:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789043125.322002:0:15901:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789043125.322003:0:15901:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789043125.322027:0:15901:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789043125.322050:0:15901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15901:1875947267658752:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789043125.322117:0:15901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043125.322169:0:15901:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a76602c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789043125.323809:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267658752 00000100:00100000:1.0:1789043125.323820:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267658752 00000100:00100000:1.0:1789043125.323866:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789043125.323875:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f908850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+19:15901:x1875947267658752:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789043125.323905:0:14495:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789043125.323919:0:14495:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789043125.361441:0:14495:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789043125.361460:0:14495:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789043125.361574:0:14517:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789043125.361579:0:14517:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789043125.361601:0:14517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa069418ace00/0x99260d7389c07192 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043125.361621:0:14517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a50979e00/0x99260d7389c07065 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c0705e expref: 19 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043125.361630:0:14517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa069418ace00/0x99260d7389c07192 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043125.361678:0:14517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a50979e00/0x99260d7389c07065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99260d7389c0705e expref: 19 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043125.361692:0:14517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa06a50979e00/0x99260d7389c07065 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99260d7389c0705e expref: 19 pid: 14496 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043125.361706:0:14517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767e9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14517:1875947267658880:0@lo:104: 00000100:00100000:0.0:1789043125.361778:0:14517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043125.361820:0:14517:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a76602840 going to sleep for 11 seconds 00000100:00100000:1.0:1789043125.361884:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267658880 00000100:00100000:1.0:1789043125.361892:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267658880 00000100:00100000:1.0:1789043125.361941:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789043125.361950:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff892c07-94a8-4144-ae30-5a70a83d490b+3:14517:x1875947267658880:12345-0@lo:104: 00010000:00010000:1.0:1789043125.361968:0:14484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffffa06a41686800/0x99260d7389c0705e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c07065 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043125.362022:0:14484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789043125.362028:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff892c07-94a8-4144-ae30-5a70a83d490b+3:14517:x1875947267658880:12345-0@lo:104: Request processed in 79us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043125.362036:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789043125.362056:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789043125.362062:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a41686800/0x99260d7389c0705e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c07065 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043125.362070:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686800 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:1.0:1789043125.362074:0:14490:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a41686800/0x99260d7389c0705e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x99260d7389c07065 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043125.362084:0:14490:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a41686800/0x99260d7389c0705e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x99260d7389c07065 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789043125.362092:0:14490:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a41686800/0x99260d7389c0705e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x99260d7389c07065 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789043125.362098:0:14490:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789043125.362124:0:14490:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a41686800/0x99260d7389c0705e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c07065 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043125.362130:0:14490:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789043125.362158:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a41686800/0x99260d7389c0705e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c07065 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043125.362166:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a41686800/0x99260d7389c0705e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c07065 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043125.362189:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043125.362191:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043125.362192:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789043125.362211:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff892c07-94a8-4144-ae30-5a70a83d490b:3313:1875947267659008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789043125.362240:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043125.362284:0:14517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767e9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14517:1875947267658880:0@lo:104: 00010000:00010000:1.0:1789043125.362302:0:14517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa069418ace00/0x99260d7389c07192 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043125.363826:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267659008 00000100:00100000:0.0:1789043125.363838:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267659008 00010000:00010000:0.0:1789043125.363871:0:14488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a50979e00/0x99260d7389c07065 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c0705e expref: 20 pid: 14496 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043125.363912:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789043125.363920:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6edbb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ff892c07-94a8-4144-ae30-5a70a83d490b+20:3313:x1875947267659008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789043125.363932:0:14488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789043125.363937:0:14488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a50979e00/0x99260d7389c07065 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c0705e expref: 20 pid: 14496 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043125.363949:0:14488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a50979e00/0x99260d7389c07065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99260d7389c0705e expref: 20 pid: 14496 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043125.363964:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a50979e00/0x99260d7389c07065 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99260d7389c0705e expref: 20 pid: 14496 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043125.363980:0:14488:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa069418ace00/0x99260d7389c07192 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043125.363989:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa069418ace00/0x99260d7389c07192 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789043125.364004:0:14488:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002425094s 00010000:00010000:0.0:1789043125.364009:0:14488:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa069418ace00/0x99260d7389c07192 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043125.364017:0:14488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa069418ace00/0x99260d7389c07192 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043125.364043:0:14488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa069418ace00/0x99260d7389c07192 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043125.364051:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa069418ace00/0x99260d7389c07192 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043125.364058:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa069418ace00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789043125.364063:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa069418ace00/0x99260d7389c07192 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043125.364071:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa069418ace00/0x99260d7389c07192 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043125.364084:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa069418ace00/0x99260d7389c07192 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043125.364095:0:14488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789043125.364148:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6edbb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ff892c07-94a8-4144-ae30-5a70a83d490b+19:3313:x1875947267659008:12345-0@lo:103:ldlm_bl.0 Request processed in 227us (1906us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043125.364163:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789043125.364233:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff892c07-94a8-4144-ae30-5a70a83d490b:3313:1875947267659008:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789043125.364260:0:14517:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa069418ace00/0x99260d7389c07192 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043125.364267:0:14517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa069418ace00/0x99260d7389c07192 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043125.364272:0:14517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa069418ace00/0x99260d7389c07192 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043125.371413:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f908850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+18:15901:x1875947267658752:12345-0@lo:253:mount.lustre.0 Request processed in 47531us (49287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043125.371427:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789043125.374775:0:15901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff892c07-94a8-4144-ae30-5a70a83d490b:15901:1875947267658752:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789043125.374796:0:15901:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789043125.374799:0:15901:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789043125.374801:0:15901:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789043125.374802:0:15901:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789043125.374804:0:15901:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789043125.374805:0:15901:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789043125.374827:0:15901:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789043125.374828:0:15901:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789043125.374831:0:15901:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789043125.374832:0:15901:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789043125.374848:0:15901:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789043125.379718:0:15901:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789043125.379852:0:15901:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789043125.379978:0:15901:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789043125.380098:0:15901:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789043125.380338:0:15901:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789043125.380559:0:15901:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789043125.381990:0:15901:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1789043125.431555:0:15901:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789043125.431563:0:15901:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789043125.431600:0:15901:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789043125.431669:0:15901:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.117@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789043125.431683:0:15901:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789043125.431715:0:15901:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1789043125.878052:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789043126.790700:0:14499:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789043126.790709:0:14499:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa06a7f846000 from 8 10000000:01000000:1.0:1789043126.790715:0:14499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789043126.790778:0:14499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41687400/0x99260d7389c07199 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043126.790792:0:14499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a41687400/0x99260d7389c07199 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043126.790822:0:14499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a41687400/0x99260d7389c07199 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043126.790856:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edb8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff892c07-94a8-4144-ae30-5a70a83d490b:14499:1875947267659136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789043126.790943:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043126.790998:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a467b4000 going to sleep for 11 seconds 00000100:00100000:1.0:1789043126.791041:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267659136 00000100:00100000:1.0:1789043126.791050:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267659136 00000100:00100000:1.0:1789043126.791106:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789043126.791116:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f909450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+18:14499:x1875947267659136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789043126.791132:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043126.791160:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a41687600/0x99260d7389c071a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c07199 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043126.791200:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a41687600/0x99260d7389c071a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c07199 expref: 19 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043126.791212:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a41687600/0x99260d7389c071a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c07199 expref: 19 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043126.791222:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41687600, rc 0) 00000100:00100000:1.0:1789043126.791267:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f909450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+19:14499:x1875947267659136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043126.791274:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789043126.791324:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edb8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff892c07-94a8-4144-ae30-5a70a83d490b:14499:1875947267659136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789043126.791340:0:14499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a41687400/0x99260d7389c07199 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c071a0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043126.792849:0:14499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a41687400/0x99260d7389c07199 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c071a0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043126.792947:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edb8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff892c07-94a8-4144-ae30-5a70a83d490b:14499:1875947267659264:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789043126.793016:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043126.793064:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a467b4000 going to sleep for 11 seconds 00000100:00100000:2.0:1789043126.793754:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267659264 00000100:00100000:2.0:1789043126.793766:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267659264 00000100:00100000:2.0:1789043126.793814:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789043126.793824:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f90b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+19:14499:x1875947267659264:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789043126.793847:0:14495:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789043126.793865:0:14495:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789043126.793869:0:14495:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1789043126.793990:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f90b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+19:14499:x1875947267659264:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 166us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043126.793998:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789043126.799882:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edb8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff892c07-94a8-4144-ae30-5a70a83d490b:14499:1875947267659264:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789043126.800013:0:14499:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789043126.800027:0:14499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41687400/0x99260d7389c07199 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c071a0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043126.800040:0:14499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a41687400/0x99260d7389c07199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c071a0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043126.898895:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789043127.748449:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1789043127.748564:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1789043127.927449:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789043128.562807:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267659392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789043128.565041:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043128.565179:0:15189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267659392 00000100:00100000:3.0:1789043128.565188:0:15189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267659392 00000100:00100000:3.0:1789043128.565245:0:15189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789043128.565256:0:15189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267659392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789043128.565290:0:15189:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789043128.565355:0:15189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267659392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (2478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043128.565362:0:15189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789043128.565400:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789043128.565429:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789043128.565452:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267659392:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789043128.948407:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043129.970666:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789043130.297312:0:14533:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1789043130.612077:0:470:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789043130.612084:0:470:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789043130.612088:0:470:0:(import.c:65:import_set_state_nolock()) ffffa06a7730f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789043130.612100:0:470:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa06a7730f000 using connection 192.168.203.117@tcp/0@lo 00000100:00100000:1.0:1789043130.612129:0:470:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa06a6edbbb80 x1875947267659776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789043130.612204:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ff892c07-94a8-4144-ae30-5a70a83d490b:3315:1875947267659520:0@lo:400:kworker.0 00000100:00100000:1.0:1789043130.612268:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043130.612310:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875947267660160:0@lo:400:kworker.0 00000100:00100000:1.0:1789043130.612332:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043130.612355:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789043130.612359:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875947267660032:0@lo:400:kworker.0 00000100:00100000:1.0:1789043130.612376:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043130.612399:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267659648:0@lo:400:kworker.0 00000100:00100000:1.0:1789043130.612419:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043130.612433:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789043130.612437:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875947267659904:0@lo:400:kworker.0 00000100:00100000:1.0:1789043130.612464:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043130.612485:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a6edbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875947267659776:0@lo:8:kworker.0 00000100:00100000:1.0:1789043130.612503:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043130.612547:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267660160 00000100:00100000:1.0:1789043130.612553:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267660160 00000100:00100000:1.0:1789043130.612610:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267660032 00000100:00100000:1.0:1789043130.612612:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267660032 00000100:00100000:1.0:1789043130.612624:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267659904 00000100:00100000:1.0:1789043130.612626:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267659904 00000100:00100000:1.0:1789043130.612638:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789043130.612645:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6edbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875947267660160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789043130.612687:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6edbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875947267660160:12345-0@lo:400:kworker.0 Request processed in 42us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043130.612693:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789043130.613694:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789043130.613722:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6edb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875947267660032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789043130.613769:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6edb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875947267660032:12345-0@lo:400:kworker.0 Request processed in 67us (1392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043130.613775:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789043130.613789:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789043130.613797:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6edba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875947267659904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789043130.613835:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6edba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875947267659904:12345-0@lo:400:kworker.0 Request processed in 39us (1370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043130.613841:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789043130.613997:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267659648 00000100:00100000:1.0:1789043130.614004:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267659648 00000100:00100000:1.0:1789043130.614038:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267659776 00000100:00100000:1.0:1789043130.614049:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267659776 00000100:00100000:1.0:1789043130.614064:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789043130.614072:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6edb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267659648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789043130.614105:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6edb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267659648:12345-0@lo:400:kworker.0 Request processed in 35us (1684us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043130.614111:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789043130.614131:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789043130.614136:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6edb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3311:x1875947267659776:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789043130.614160:0:15185:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:1.0:1789043130.614190:0:15185:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x99260d7389c071a7 00002000:00100000:1.0:1789043130.614204:0:15185:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffffa06941214800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789043130.614208:0:15185:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1789043130.614210:0:15185:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1789043130.615483:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267659520 00000100:00100000:2.0:1789043130.615494:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267659520 00000100:00100000:2.0:1789043130.615564:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789043130.615574:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f909850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+19:3315:x1875947267659520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789043130.615650:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f909850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff892c07-94a8-4144-ae30-5a70a83d490b+19:3315:x1875947267659520:12345-0@lo:400:kworker.0 Request processed in 78us (3381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043130.615666:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00002000:00080000:1.0:1789043130.615994:0:15185:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789043130.616024:0:15185:0:(import.c:65:import_set_state_nolock()) ffffa06941215000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789043130.616067:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6edb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1875947267659776:12345-0@lo:8:kworker.0 Request processed in 1929us (3562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043130.616074:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1789043130.616108:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789043130.616123:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789043130.618006:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a6edbbb80 x1875947267659776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789043155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789043130.618028:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789043130.618036:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789043130.618043:0:3311:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789043130.618046:0:3311:0:(import.c:65:import_set_state_nolock()) ffffa06a7730f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789043130.618061:0:3311:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789043130.618068:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875947267659776:0@lo:8:kworker.0 00000004:00080000:2.0:1789043130.618141:0:14526:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:2.0:1789043130.618162:0:14526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14526:1875947267660416:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789043130.618215:0:14526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043130.618240:0:14526:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a472d5d80 going to sleep for 11 seconds 00000004:00080000:2.0:1789043130.618256:0:14525:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1789043130.618800:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267660288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789043130.618837:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789043130.619063:0:14525:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 473575548223ns, next at 0ns, rc = 0 00000100:00100000:2.0:1789043130.619093:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267660416 00000100:00100000:2.0:1789043130.619101:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267660416 00000100:00100000:2.0:1789043130.619161:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789043130.619169:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14526:x1875947267660416:12345-0@lo:5:osp-pre-1-0.0 00010000:00080000:1.0:1789043130.619783:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a6edb9500 x1875947267659904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789043146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789043130.619798:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875947267659904:0@lo:400:kworker.0 00000100:00100000:1.0:1789043130.619813:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267659648:0@lo:400:kworker.0 00000100:00100000:1.0:1789043130.619936:0:15189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267660288 00000100:00100000:1.0:1789043130.619942:0:15189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267660288 00000100:00100000:1.0:1789043130.619975:0:15189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789043130.619983:0:15189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6edbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875947267660288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789043130.620006:0:15189:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789043130.620060:0:15189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6edbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875947267660288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (1222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043130.620067:0:15189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789043130.625397:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a6edbad80 x1875947267660032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789043146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789043130.625415:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875947267660032:0@lo:400:kworker.0 00000100:00100000:1.0:1789043130.625428:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ff892c07-94a8-4144-ae30-5a70a83d490b:3315:1875947267659520:0@lo:400:kworker.0 00010000:00080000:1.0:1789043130.625439:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a6edb8a80 x1875947267660160/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789043146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789043130.625447:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a6edb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875947267660160:0@lo:400:kworker.0 00000100:00080000:2.0:1789043130.626617:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789043130.626648:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7f8c5c00 x1875947267660288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789043146 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789043130.626672:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267660288:0@lo:13:osp-pre-1-0.0 00002000:00080000:2.0:1789043130.629266:0:15185:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1789043130.629277:0:15185:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1789043130.629283:0:15185:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:2.0:1789043130.643777:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789043130.643788:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091dc7aae/0x99260d7389c071ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.643817:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789043130.643822:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789043130.643828:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091dc7aae/0x99260d7389c071ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.643845:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091dc7aae/0x99260d7389c071ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.643855:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091dc7aae/0x99260d7389c071ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.643863:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091dc7aae/0x99260d7389c071ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.643890:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789043130.645354:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789043130.645365:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091dc7aae/0x99260d7389c071ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.645388:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979800 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789043130.645392:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091dc7aae/0x99260d7389c071ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.645403:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091dc7aae/0x99260d7389c071ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.645422:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091dc7aae/0x99260d7389c071ae lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.645430:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091dc7aae/0x99260d7389c071ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.645448:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043130.645450:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043130.645452:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789043130.646239:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789043130.646248:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f52dbeaf/0x99260d7389c071b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.646260:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789043130.646264:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789043130.646269:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f52dbeaf/0x99260d7389c071b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.646279:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f52dbeaf/0x99260d7389c071b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.646298:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f52dbeaf/0x99260d7389c071b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.646306:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f52dbeaf/0x99260d7389c071b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.646324:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789043130.648625:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789043130.648637:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f52dbeaf/0x99260d7389c071b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043130.648650:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979200 already unused, calling callback (ffffffffc1470760) 00010000:00010000:3.0:1789043130.648654:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f52dbeaf/0x99260d7389c071b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043130.648664:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f52dbeaf/0x99260d7389c071b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043130.648685:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f52dbeaf/0x99260d7389c071b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043130.648692:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f52dbeaf/0x99260d7389c071b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043130.648713:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043130.648715:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043130.648717:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789043130.649004:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789043130.649012:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000456b7e65/0x99260d7389c071bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.649024:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789043130.649028:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789043130.649034:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000456b7e65/0x99260d7389c071bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.649045:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000456b7e65/0x99260d7389c071bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.649055:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000456b7e65/0x99260d7389c071bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.649061:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000456b7e65/0x99260d7389c071bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.649101:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789043130.650343:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789043130.650352:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000456b7e65/0x99260d7389c071bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043130.650374:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979a00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:3.0:1789043130.650379:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000456b7e65/0x99260d7389c071bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043130.650388:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000456b7e65/0x99260d7389c071bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043130.650482:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000456b7e65/0x99260d7389c071bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043130.650490:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000456b7e65/0x99260d7389c071bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043130.650510:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043130.650511:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043130.650531:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789043130.652693:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789043130.652705:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005490156d/0x99260d7389c071c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.652721:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789043130.652726:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789043130.652732:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005490156d/0x99260d7389c071c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.652746:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005490156d/0x99260d7389c071c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.652756:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005490156d/0x99260d7389c071c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.652763:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005490156d/0x99260d7389c071c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.652781:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789043130.652793:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789043130.652798:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005490156d/0x99260d7389c071c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.652806:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50978800 already unused, calling callback (ffffffffc1470760) 00010000:00010000:2.0:1789043130.652816:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005490156d/0x99260d7389c071c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.652824:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005490156d/0x99260d7389c071c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.652838:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005490156d/0x99260d7389c071c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.652845:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005490156d/0x99260d7389c071c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.652861:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043130.652862:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043130.652864:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789043130.653333:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789043130.653339:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9e892b0/0x99260d7389c071ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.653349:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789043130.653352:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789043130.653356:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9e892b0/0x99260d7389c071ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.653365:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9e892b0/0x99260d7389c071ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.653373:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9e892b0/0x99260d7389c071ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.653385:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9e892b0/0x99260d7389c071ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.654328:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789043130.654805:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789043130.654814:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9e892b0/0x99260d7389c071ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.654824:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50978a00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789043130.654829:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9e892b0/0x99260d7389c071ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.654839:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9e892b0/0x99260d7389c071ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.654933:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9e892b0/0x99260d7389c071ca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.654943:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9e892b0/0x99260d7389c071ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.654963:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043130.654965:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043130.654967:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789043130.655367:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789043130.655375:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d300ded4/0x99260d7389c071d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.655386:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789043130.655390:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789043130.655395:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d300ded4/0x99260d7389c071d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.655407:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d300ded4/0x99260d7389c071d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.655416:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d300ded4/0x99260d7389c071d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.655423:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d300ded4/0x99260d7389c071d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.655488:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789043130.656122:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789043130.656130:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009afb1961/0x99260d7389c071d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.656149:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789043130.656152:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789043130.656156:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009afb1961/0x99260d7389c071d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.656165:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009afb1961/0x99260d7389c071d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.656173:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009afb1961/0x99260d7389c071d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.656181:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009afb1961/0x99260d7389c071d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.656449:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789043130.656457:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d300ded4/0x99260d7389c071d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.656465:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50978600 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789043130.656470:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d300ded4/0x99260d7389c071d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.656479:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d300ded4/0x99260d7389c071d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.656493:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d300ded4/0x99260d7389c071d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.656501:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d300ded4/0x99260d7389c071d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.656541:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789043130.656544:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009afb1961/0x99260d7389c071d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.656551:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979e00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789043130.656554:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009afb1961/0x99260d7389c071d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.656562:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009afb1961/0x99260d7389c071d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.656572:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009afb1961/0x99260d7389c071d8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.656579:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043130.656580:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043130.656582:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043130.656663:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789043130.656668:0:15185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009afb1961/0x99260d7389c071d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.657156:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789043130.657404:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789043130.657410:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4691e4d/0x99260d7389c071df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.657420:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789043130.657424:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789043130.657429:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4691e4d/0x99260d7389c071df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.657447:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4691e4d/0x99260d7389c071df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.657455:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4691e4d/0x99260d7389c071df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.657462:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4691e4d/0x99260d7389c071df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.657530:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789043130.658055:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789043130.661181:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000238bf5ce/0x99260d7389c071e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.661208:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789043130.661213:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789043130.661221:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000238bf5ce/0x99260d7389c071e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.661235:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000238bf5ce/0x99260d7389c071e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.661246:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000238bf5ce/0x99260d7389c071e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.661273:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000238bf5ce/0x99260d7389c071e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.662812:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789043130.662826:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4691e4d/0x99260d7389c071df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.662838:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50978c00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789043130.662843:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4691e4d/0x99260d7389c071df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.662966:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4691e4d/0x99260d7389c071df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.662988:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4691e4d/0x99260d7389c071df lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.662996:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4691e4d/0x99260d7389c071df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789043130.663031:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:0.0:1789043130.663082:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789043130.663086:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000238bf5ce/0x99260d7389c071e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.663092:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50978200 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789043130.663095:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000238bf5ce/0x99260d7389c071e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.663102:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000238bf5ce/0x99260d7389c071e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.663121:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000238bf5ce/0x99260d7389c071e6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.663129:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043130.663136:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043130.663139:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043130.671722:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789043130.671736:0:15185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000238bf5ce/0x99260d7389c071e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.672010:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789043130.672659:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789043130.672666:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbda10cc/0x99260d7389c071ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.672680:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789043130.672684:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789043130.672691:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbda10cc/0x99260d7389c071ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.674209:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbda10cc/0x99260d7389c071ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.674229:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbda10cc/0x99260d7389c071ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.674237:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cbda10cc/0x99260d7389c071ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.674275:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789043130.675147:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789043130.675156:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005490156d/0x99260d7389c071f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.675170:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789043130.675175:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789043130.675181:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005490156d/0x99260d7389c071f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.675192:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005490156d/0x99260d7389c071f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.675202:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005490156d/0x99260d7389c071f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.675209:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005490156d/0x99260d7389c071f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.675242:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789043130.675686:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789043130.675693:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000456b7e65/0x99260d7389c071fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.676799:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1789043130.676809:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789043130.676813:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789043130.676817:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cbda10cc/0x99260d7389c071ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.676819:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000456b7e65/0x99260d7389c071fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.676828:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979600 already unused, calling callback (ffffffffc1470760) 00010000:00010000:1.0:1789043130.676832:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbda10cc/0x99260d7389c071ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.676833:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000456b7e65/0x99260d7389c071fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.676843:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000456b7e65/0x99260d7389c071fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.676846:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbda10cc/0x99260d7389c071ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.676852:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000456b7e65/0x99260d7389c071fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.676865:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cbda10cc/0x99260d7389c071ed lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.676872:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbda10cc/0x99260d7389c071ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.676893:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789043130.676897:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005490156d/0x99260d7389c071f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.676904:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50978800 already unused, calling callback (ffffffffc1470760) 00010000:00010000:1.0:1789043130.676907:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005490156d/0x99260d7389c071f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.676915:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005490156d/0x99260d7389c071f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.676924:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789043130.676925:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005490156d/0x99260d7389c071f4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.676931:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005490156d/0x99260d7389c071f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.676953:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789043130.676957:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000456b7e65/0x99260d7389c071fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.676963:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979a00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:1.0:1789043130.676966:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000456b7e65/0x99260d7389c071fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.676972:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000456b7e65/0x99260d7389c071fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.676981:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000456b7e65/0x99260d7389c071fb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.676988:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000456b7e65/0x99260d7389c071fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.676998:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043130.677000:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043130.677002:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789043130.677618:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789043130.677625:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f52dbeaf/0x99260d7389c07202 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.677635:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789043130.677638:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789043130.677641:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f52dbeaf/0x99260d7389c07202 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.677651:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f52dbeaf/0x99260d7389c07202 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.677659:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f52dbeaf/0x99260d7389c07202 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.677673:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f52dbeaf/0x99260d7389c07202 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.677691:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789043130.677765:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789043130.677769:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f52dbeaf/0x99260d7389c07202 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.677777:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979200 already unused, calling callback (ffffffffc1470760) 00010000:00010000:1.0:1789043130.677787:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f52dbeaf/0x99260d7389c07202 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.677796:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f52dbeaf/0x99260d7389c07202 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.677807:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f52dbeaf/0x99260d7389c07202 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.677814:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f52dbeaf/0x99260d7389c07202 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.677823:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043130.677827:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043130.677828:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043130.677830:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789043130.679400:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789043130.679410:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091dc7aae/0x99260d7389c07209 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.679422:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789043130.679425:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789043130.679431:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091dc7aae/0x99260d7389c07209 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.679442:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091dc7aae/0x99260d7389c07209 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.679452:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091dc7aae/0x99260d7389c07209 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.679460:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091dc7aae/0x99260d7389c07209 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.679489:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789043130.680318:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789043130.680328:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091dc7aae/0x99260d7389c07209 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043130.680338:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50979800 already unused, calling callback (ffffffffc1470760) 00010000:00010000:3.0:1789043130.680343:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091dc7aae/0x99260d7389c07209 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043130.680352:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091dc7aae/0x99260d7389c07209 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043130.680375:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091dc7aae/0x99260d7389c07209 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043130.680383:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091dc7aae/0x99260d7389c07209 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043130.680414:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043130.680416:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043130.680418:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789043130.680429:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789043130.680435:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d6ef0b6/0x99260d7389c07210 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.680449:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789043130.680452:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789043130.680457:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d6ef0b6/0x99260d7389c07210 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.680466:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d6ef0b6/0x99260d7389c07210 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.680475:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d6ef0b6/0x99260d7389c07210 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.680482:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d6ef0b6/0x99260d7389c07210 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.680507:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789043130.680548:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789043130.680554:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d6ef0b6/0x99260d7389c07210 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.680561:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a7fa6e400 already unused, calling callback (ffffffffc1470760) 00010000:00010000:1.0:1789043130.680565:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d6ef0b6/0x99260d7389c07210 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.680573:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d6ef0b6/0x99260d7389c07210 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.680585:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d6ef0b6/0x99260d7389c07210 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.680610:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d6ef0b6/0x99260d7389c07210 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.680624:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043130.680625:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043130.680627:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789043130.681160:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789043130.681167:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5340847/0x99260d7389c07217 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.681177:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789043130.681180:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789043130.681184:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5340847/0x99260d7389c07217 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.681193:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5340847/0x99260d7389c07217 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.681213:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5340847/0x99260d7389c07217 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.681220:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5340847/0x99260d7389c07217 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.681241:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789043130.681483:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789043130.681489:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5340847/0x99260d7389c07217 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043130.681497:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a7fa6e200 already unused, calling callback (ffffffffc1470760) 00010000:00010000:3.0:1789043130.681502:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5340847/0x99260d7389c07217 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043130.681510:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5340847/0x99260d7389c07217 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043130.681546:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5340847/0x99260d7389c07217 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043130.681554:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5340847/0x99260d7389c07217 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043130.681583:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043130.681585:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043130.681586:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789043130.681657:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789043130.681664:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ceac0f5c/0x99260d7389c0721e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.681672:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789043130.681675:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789043130.681679:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ceac0f5c/0x99260d7389c0721e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.681688:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ceac0f5c/0x99260d7389c0721e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.681697:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ceac0f5c/0x99260d7389c0721e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.681991:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ceac0f5c/0x99260d7389c0721e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.682026:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789043130.682093:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789043130.682100:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ceac0f5c/0x99260d7389c0721e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.682108:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a7fa6e800 already unused, calling callback (ffffffffc1470760) 00010000:00010000:1.0:1789043130.682111:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ceac0f5c/0x99260d7389c0721e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.682134:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ceac0f5c/0x99260d7389c0721e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.682146:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ceac0f5c/0x99260d7389c0721e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.682153:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ceac0f5c/0x99260d7389c0721e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.682169:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043130.682171:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043130.682172:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789043130.682455:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789043130.682461:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd4b2475/0x99260d7389c07225 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.682469:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789043130.682473:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789043130.682477:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd4b2475/0x99260d7389c07225 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.682487:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd4b2475/0x99260d7389c07225 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.682495:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd4b2475/0x99260d7389c07225 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.682502:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd4b2475/0x99260d7389c07225 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.682535:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789043130.682583:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789043130.682663:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd4b2475/0x99260d7389c07225 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043130.682672:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a7fa6ea00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:3.0:1789043130.682676:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd4b2475/0x99260d7389c07225 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043130.682684:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd4b2475/0x99260d7389c07225 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043130.682697:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd4b2475/0x99260d7389c07225 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043130.682704:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd4b2475/0x99260d7389c07225 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043130.682718:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043130.682720:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043130.682722:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789043130.688315:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789043130.688328:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000711f751f/0x99260d7389c0722c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.688345:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789043130.688355:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789043130.688362:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000711f751f/0x99260d7389c0722c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.688377:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000711f751f/0x99260d7389c0722c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.688388:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000711f751f/0x99260d7389c0722c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.688395:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000711f751f/0x99260d7389c0722c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.688423:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789043130.689438:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789043130.689449:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000711f751f/0x99260d7389c0722c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.689461:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a7fa6ee00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789043130.689466:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000711f751f/0x99260d7389c0722c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.689475:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000711f751f/0x99260d7389c0722c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.689493:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000711f751f/0x99260d7389c0722c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.689500:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000711f751f/0x99260d7389c0722c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.689546:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043130.689548:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043130.689550:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789043130.690315:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789043130.690325:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b06f3f8e/0x99260d7389c07233 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.690337:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789043130.690341:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789043130.690346:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b06f3f8e/0x99260d7389c07233 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.690358:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b06f3f8e/0x99260d7389c07233 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.690367:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b06f3f8e/0x99260d7389c07233 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.690380:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b06f3f8e/0x99260d7389c07233 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.690402:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789043130.691321:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789043130.691330:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b06f3f8e/0x99260d7389c07233 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.691352:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a7fa6e600 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789043130.691356:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b06f3f8e/0x99260d7389c07233 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.691365:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b06f3f8e/0x99260d7389c07233 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.691381:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b06f3f8e/0x99260d7389c07233 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.691399:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b06f3f8e/0x99260d7389c07233 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043130.691419:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043130.691421:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043130.691422:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789043130.692218:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789043130.692229:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0226071/0x99260d7389c0723a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.692243:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789043130.692247:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789043130.692253:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0226071/0x99260d7389c0723a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.692266:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0226071/0x99260d7389c0723a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.692275:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0226071/0x99260d7389c0723a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.692282:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0226071/0x99260d7389c0723a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.692307:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789043130.692417:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789043130.692425:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0226071/0x99260d7389c0723a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.692433:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a7fa6f400 already unused, calling callback (ffffffffc1470760) 00010000:00010000:1.0:1789043130.692437:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0226071/0x99260d7389c0723a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.692444:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0226071/0x99260d7389c0723a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.692459:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0226071/0x99260d7389c0723a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.692467:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0226071/0x99260d7389c0723a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.692483:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043130.692485:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043130.692486:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789043130.693593:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789043130.693603:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cfde0f6/0x99260d7389c07241 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.693621:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789043130.693625:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789043130.693630:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cfde0f6/0x99260d7389c07241 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.693641:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cfde0f6/0x99260d7389c07241 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.693650:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cfde0f6/0x99260d7389c07241 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.693658:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000cfde0f6/0x99260d7389c07241 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.693683:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789043130.693735:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789043130.693742:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000cfde0f6/0x99260d7389c07241 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043130.693759:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a7fa6fc00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:3.0:1789043130.693763:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000cfde0f6/0x99260d7389c07241 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043130.693772:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000cfde0f6/0x99260d7389c07241 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043130.693786:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000cfde0f6/0x99260d7389c07241 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043130.693793:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cfde0f6/0x99260d7389c07241 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043130.693808:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043130.693810:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043130.693811:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789043130.694317:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789043130.694324:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007810de65/0x99260d7389c07248 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.694333:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789043130.694336:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789043130.694341:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007810de65/0x99260d7389c07248 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.694351:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007810de65/0x99260d7389c07248 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.694371:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007810de65/0x99260d7389c07248 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.694379:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007810de65/0x99260d7389c07248 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.694399:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789043130.694423:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789043130.694429:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007810de65/0x99260d7389c07248 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.694437:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a7fa6e000 already unused, calling callback (ffffffffc1470760) 00010000:00010000:1.0:1789043130.694441:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007810de65/0x99260d7389c07248 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.694458:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007810de65/0x99260d7389c07248 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.694470:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007810de65/0x99260d7389c07248 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.694478:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007810de65/0x99260d7389c07248 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.694493:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043130.694495:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043130.694497:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789043130.695056:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789043130.695122:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdc2da61/0x99260d7389c0724f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.695132:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789043130.695135:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789043130.695140:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdc2da61/0x99260d7389c0724f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.695150:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fdc2da61/0x99260d7389c0724f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.695158:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdc2da61/0x99260d7389c0724f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.695165:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fdc2da61/0x99260d7389c0724f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.695196:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789043130.695217:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789043130.695222:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fdc2da61/0x99260d7389c0724f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043130.695229:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a58604400 already unused, calling callback (ffffffffc1470760) 00010000:00010000:3.0:1789043130.695233:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdc2da61/0x99260d7389c0724f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043130.695241:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdc2da61/0x99260d7389c0724f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043130.695259:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fdc2da61/0x99260d7389c0724f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043130.695266:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fdc2da61/0x99260d7389c0724f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043130.695280:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043130.695282:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043130.695284:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789043130.695625:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789043130.695631:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a63a797/0x99260d7389c07256 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.695640:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789043130.695643:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789043130.695647:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a63a797/0x99260d7389c07256 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.695656:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a63a797/0x99260d7389c07256 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.695663:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a63a797/0x99260d7389c07256 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.695671:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a63a797/0x99260d7389c07256 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.695689:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789043130.696197:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789043130.696203:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a63a797/0x99260d7389c07256 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.696211:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a58604c00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:1.0:1789043130.696215:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a63a797/0x99260d7389c07256 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.696223:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a63a797/0x99260d7389c07256 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.696236:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a63a797/0x99260d7389c07256 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.696254:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a63a797/0x99260d7389c07256 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.696270:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043130.696272:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043130.696274:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789043130.696533:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789043130.696540:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009da7f348/0x99260d7389c0725d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.696549:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789043130.696557:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789043130.696563:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009da7f348/0x99260d7389c0725d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.696572:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009da7f348/0x99260d7389c0725d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.696581:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009da7f348/0x99260d7389c0725d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.696588:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009da7f348/0x99260d7389c0725d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.696647:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789043130.697165:0:15185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789043130.697171:0:15185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000991e013c/0x99260d7389c07264 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.697180:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1789043130.697183:0:15185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789043130.697187:0:15185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000991e013c/0x99260d7389c07264 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.697195:0:15185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000991e013c/0x99260d7389c07264 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.697203:0:15185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000991e013c/0x99260d7389c07264 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043130.697217:0:15185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000991e013c/0x99260d7389c07264 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.698393:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789043130.698404:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009da7f348/0x99260d7389c0725d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.698480:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a58605800 already unused, calling callback (ffffffffc1470760) 00010000:00010000:1.0:1789043130.698485:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009da7f348/0x99260d7389c0725d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.698495:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009da7f348/0x99260d7389c0725d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.698526:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009da7f348/0x99260d7389c0725d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.698534:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009da7f348/0x99260d7389c0725d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.698556:0:14489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789043130.698559:0:14489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000991e013c/0x99260d7389c07264 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.698578:0:14489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a58604000 already unused, calling callback (ffffffffc1470760) 00010000:00010000:1.0:1789043130.698582:0:14489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000991e013c/0x99260d7389c07264 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.698590:0:14489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000991e013c/0x99260d7389c07264 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.698600:0:14489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000991e013c/0x99260d7389c07264 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043130.698607:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043130.698608:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043130.698610:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043130.700037:0:15185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789043130.700048:0:15185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000991e013c/0x99260d7389c07264 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043130.700090:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1789043130.700511:0:15185:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:2.0:1789043130.700624:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14526:x1875947267660416:12345-0@lo:5:osp-pre-1-0.0 Request processed in 81452us (82405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043130.700634:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789043130.700678:0:14526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14526:1875947267660416:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789043130.700696:0:14526:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:3.0:1789043130.700751:0:14526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a027100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14526:1875947267660544:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789043130.700795:0:14526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043130.700838:0:14526:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a7f8cecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789043130.701543:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267660544 00000100:00100000:2.0:1789043130.701552:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267660544 00000100:00100000:2.0:1789043130.701598:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789043130.701607:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a027480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14526:x1875947267660544:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789043130.701645:0:15187:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1789043130.713160:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a027480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14526:x1875947267660544:12345-0@lo:5:osp-pre-1-0.0 Request processed in 11547us (12358us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789043130.713171:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789043130.713450:0:14526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a027100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14526:1875947267660544:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789043130.713465:0:14526:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1789043130.998504:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043132.019809:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789043132.716047:0:16256:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg317-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789043133.052477:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789043133.688955:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789043133.688988:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267660672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789043133.689079:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043133.689718:0:15189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267660672 00000100:00100000:3.0:1789043133.689732:0:15189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267660672 00000100:00100000:3.0:1789043133.689808:0:15189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789043133.689821:0:15189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267660672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789043133.689874:0:15189:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789043133.689939:0:15189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267660672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043133.689955:0:15189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789043133.689985:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789043133.690120:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267660672:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789043134.067369:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043135.094996:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789043135.360041:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043135.360313:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242495872 00000100:00100000:1.0:1789043135.360328:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242495872 00000100:00100000:1.0:1789043135.360412:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 75 00000100:00100000:1.0:1789043135.360422:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f908450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2348:x1875947242495872:12345-192.168.203.17@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789043135.360459:0:14496:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 5996c558-d720-4f58-965c-3a1f4ca9bdac@192.168.203.17@tcp t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:1.0:1789043135.360507:0:14496:0:(genops.c:1393:class_connect()) connect: client 5996c558-d720-4f58-965c-3a1f4ca9bdac, cookie 0x99260d7389c0726b 00000100:00080000:1.0:1789043135.360691:0:14496:0:(import.c:65:import_set_state_nolock()) ffffa06941210000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789043135.361338:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f908450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5996c558-d720-4f58-965c-3a1f4ca9bdac+5:2348:x1875947242495872:12345-192.168.203.17@tcp:250:mount.lustre.0 Request processed in 912us (1305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043135.361349:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 75 00000100:00100000:1.0:1789043135.372141:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043135.372323:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242496000 00000100:00100000:2.0:1789043135.372350:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242496000 00000100:00100000:2.0:1789043135.372428:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 76 00000100:00100000:2.0:1789043135.372861:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f90a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5996c558-d720-4f58-965c-3a1f4ca9bdac+5:13764:x1875947242496000:12345-192.168.203.17@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789043135.372887:0:14495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043135.372911:0:14495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a58605400/0x99260d7389c07272 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676cb1 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043135.372951:0:14495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a58605400/0x99260d7389c07272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676cb1 expref: 6 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043135.372965:0:14495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a58605400/0x99260d7389c07272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676cb1 expref: 6 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043135.372976:0:14495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a58605400, rc 0) 00000100:00100000:2.0:1789043135.373056:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f90a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5996c558-d720-4f58-965c-3a1f4ca9bdac+6:13764:x1875947242496000:12345-192.168.203.17@tcp:101:mount.lustre.0 Request processed in 618us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043135.373064:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 76 00000100:00100000:3.0:1789043135.375665:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043135.375828:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242496128 00000100:00100000:1.0:1789043135.375936:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242496128 00000100:00100000:1.0:1789043135.376127:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 77 00000100:00100000:1.0:1789043135.376174:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f90b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5996c558-d720-4f58-965c-3a1f4ca9bdac+6:13764:x1875947242496128:12345-192.168.203.17@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789043135.377210:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f90b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5996c558-d720-4f58-965c-3a1f4ca9bdac+6:13764:x1875947242496128:12345-192.168.203.17@tcp:501:mount.lustre.0 Request processed in 1048us (1536us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789043135.377237:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 77 00000100:00100000:3.0:1789043135.381594:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043135.382158:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242496256 00000100:00100000:2.0:1789043135.382173:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242496256 00000100:00100000:2.0:1789043135.382281:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 78 00000100:00100000:2.0:1789043135.382292:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f90b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5996c558-d720-4f58-965c-3a1f4ca9bdac+6:13764:x1875947242496256:12345-192.168.203.17@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789043135.382315:0:14495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043135.382339:0:14495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a58604e00/0x99260d7389c07279 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676cb8 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043135.382377:0:14495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a58604e00/0x99260d7389c07279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676cb8 expref: 7 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043135.382391:0:14495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a58604e00/0x99260d7389c07279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676cb8 expref: 7 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043135.382413:0:14495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a58604e00, rc 0) 00000100:00100000:2.0:1789043135.382571:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f90b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5996c558-d720-4f58-965c-3a1f4ca9bdac+7:13764:x1875947242496256:12345-192.168.203.17@tcp:101:mount.lustre.0 Request processed in 280us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043135.382579:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 78 00000100:00100000:1.0:1789043135.388274:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043135.388447:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242496384 00000100:00100000:2.0:1789043135.388463:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242496384 00000100:00100000:2.0:1789043135.389014:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 79 00000100:00100000:2.0:1789043135.389029:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f90bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5996c558-d720-4f58-965c-3a1f4ca9bdac+7:13764:x1875947242496384:12345-192.168.203.17@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789043135.389457:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f90bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5996c558-d720-4f58-965c-3a1f4ca9bdac+8:13764:x1875947242496384:12345-192.168.203.17@tcp:501:mount.lustre.0 Request processed in 426us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043135.389467:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 79 00000100:00100000:3.0:1789043135.395399:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043135.395620:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242496512 00000100:00100000:2.0:1789043135.395633:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242496512 00000100:00100000:2.0:1789043135.395702:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 80 00000100:00100000:2.0:1789043135.395714:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f90ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5996c558-d720-4f58-965c-3a1f4ca9bdac+8:13764:x1875947242496512:12345-192.168.203.17@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789043135.396693:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f90ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5996c558-d720-4f58-965c-3a1f4ca9bdac+8:13764:x1875947242496512:12345-192.168.203.17@tcp:503:mount.lustre.0 Request processed in 971us (1300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043135.396706:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 80 00000100:00100000:3.0:1789043135.398979:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043135.399078:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242496640 00000100:00100000:0.0:1789043135.399104:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242496640 00000100:00100000:0.0:1789043135.399175:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 81 00000100:00100000:0.0:1789043135.399188:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5996c558-d720-4f58-965c-3a1f4ca9bdac+8:13783:x1875947242496640:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789043135.399942:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79efcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5996c558-d720-4f58-965c-3a1f4ca9bdac+8:13783:x1875947242496640:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 754us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043135.399951:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 81 00000100:00100000:1.0:1789043135.413877:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043135.414142:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242496768 00000100:00100000:2.0:1789043135.414155:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242496768 00000100:00100000:2.0:1789043135.414225:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 82 00000100:00100000:2.0:1789043135.414302:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5996c558-d720-4f58-965c-3a1f4ca9bdac+8:13783:x1875947242496768:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789043135.414725:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79efc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5996c558-d720-4f58-965c-3a1f4ca9bdac+8:13783:x1875947242496768:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 487us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043135.414857:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 82 00000100:00100000:3.0:1789043135.419319:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043135.419434:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242496896 00000100:00100000:0.0:1789043135.419696:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242496896 00000100:00100000:0.0:1789043135.419753:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 83 00000100:00100000:0.0:1789043135.419763:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5996c558-d720-4f58-965c-3a1f4ca9bdac+8:13764:x1875947242496896:12345-192.168.203.17@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789043135.419784:0:14493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789043135.419806:0:14493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa069418ace00/0x99260d7389c07280 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676ce2 expref: -99 pid: 14493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043135.419851:0:14493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa069418ace00/0x99260d7389c07280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ce2 expref: 9 pid: 14493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043135.419863:0:14493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa069418ace00/0x99260d7389c07280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ce2 expref: 9 pid: 14493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043135.419877:0:14493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa069418ace00, rc 0) 00000100:00100000:0.0:1789043135.419957:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79efdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5996c558-d720-4f58-965c-3a1f4ca9bdac+9:13764:x1875947242496896:12345-192.168.203.17@tcp:101:mount.lustre.0 Request processed in 195us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043135.419964:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 83 00000100:00100000:3.0:1789043135.424324:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043135.424882:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242497024 00000100:00100000:2.0:1789043135.424898:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242497024 00000100:00100000:2.0:1789043135.424971:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 84 00000100:00100000:2.0:1789043135.424983:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79efe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5996c558-d720-4f58-965c-3a1f4ca9bdac+9:13764:x1875947242497024:12345-192.168.203.17@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789043135.425017:0:14495:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789043135.425044:0:14495:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789043135.425049:0:14495:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789043135.425052:0:14495:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789043135.425055:0:14495:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1789043135.436408:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79efe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5996c558-d720-4f58-965c-3a1f4ca9bdac+9:13764:x1875947242497024:12345-192.168.203.17@tcp:256:mount.lustre.0 Request processed in 11362us (12038us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043135.436428:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 84 00000100:00100000:2.0:1789043135.441808:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043135.441995:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242497152 00000100:00100000:1.0:1789043135.442010:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242497152 00000100:00100000:1.0:1789043135.443933:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 85 00000100:00100000:1.0:1789043135.443964:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79efd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5996c558-d720-4f58-965c-3a1f4ca9bdac+9:13764:x1875947242497152:12345-192.168.203.17@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789043135.443988:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043135.444012:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a41686200/0x99260d7389c07287 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676ce9 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043135.444049:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a41686200/0x99260d7389c07287 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ce9 expref: 10 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043135.444061:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a41686200/0x99260d7389c07287 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ce9 expref: 10 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043135.444094:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41686200, rc 0) 00000100:00100000:1.0:1789043135.444184:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79efd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5996c558-d720-4f58-965c-3a1f4ca9bdac+10:13764:x1875947242497152:12345-192.168.203.17@tcp:101:mount.lustre.0 Request processed in 233us (2389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043135.444211:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 85 00000100:00100000:3.0:1789043135.447370:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043135.448234:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242497280 00000100:00100000:2.0:1789043135.448316:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242497280 00000100:00100000:2.0:1789043135.448394:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 86 00000100:00100000:2.0:1789043135.448407:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79efc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5996c558-d720-4f58-965c-3a1f4ca9bdac+10:13764:x1875947242497280:12345-192.168.203.17@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789043135.449682:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79efc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5996c558-d720-4f58-965c-3a1f4ca9bdac+10:13764:x1875947242497280:12345-192.168.203.17@tcp:501:mount.lustre.0 Request processed in 1026us (2076us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043135.449698:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 86 00000100:00100000:3.0:1789043135.451980:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043135.452409:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242497408 00000100:00100000:1.0:1789043135.452423:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242497408 00000100:00100000:1.0:1789043135.452851:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 87 00000100:00100000:1.0:1789043135.452865:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5996c558-d720-4f58-965c-3a1f4ca9bdac+10:13764:x1875947242497408:12345-192.168.203.17@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789043135.453378:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79eff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5996c558-d720-4f58-965c-3a1f4ca9bdac+10:13764:x1875947242497408:12345-192.168.203.17@tcp:503:mount.lustre.0 Request processed in 513us (1409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043135.453388:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 87 00000100:00100000:3.0:1789043135.455807:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043135.455997:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242497536 00000100:00100000:2.0:1789043135.456010:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242497536 00000100:00100000:2.0:1789043135.456087:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 88 00000100:00100000:2.0:1789043135.456100:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5996c558-d720-4f58-965c-3a1f4ca9bdac+10:13787:x1875947242497536:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789043135.457188:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79efd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5996c558-d720-4f58-965c-3a1f4ca9bdac+10:13787:x1875947242497536:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 1081us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043135.457202:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 88 00000100:00100000:3.0:1789043135.460378:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043135.462778:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242497664 00000100:00100000:1.0:1789043135.462807:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242497664 00000100:00100000:1.0:1789043135.462899:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 89 00000100:00100000:1.0:1789043135.462912:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5996c558-d720-4f58-965c-3a1f4ca9bdac+10:13787:x1875947242497664:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789043135.463271:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5996c558-d720-4f58-965c-3a1f4ca9bdac+10:13787:x1875947242497664:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 359us (2903us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043135.463281:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 89 00000100:00100000:2.0:1789043135.476596:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043135.476862:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242497792 00000100:00100000:1.0:1789043135.476877:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242497792 00000100:00100000:1.0:1789043135.476939:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 4 00000100:00100000:1.0:1789043135.476950:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2348:x1875947242497792:12345-192.168.203.17@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789043135.476991:0:14502:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 58509587-cde8-42ed-8b49-4691b2633b0c@192.168.203.17@tcp t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:1.0:1789043135.477062:0:14502:0:(genops.c:1393:class_connect()) connect: client 58509587-cde8-42ed-8b49-4691b2633b0c, cookie 0x99260d7389c0728e 00000004:00100000:1.0:1789043135.477113:0:14502:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1789043135.477123:0:14502:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1789043135.540203:0:14502:0:(import.c:65:import_set_state_nolock()) ffffa06941211800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789043135.540335:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58509587-cde8-42ed-8b49-4691b2633b0c+6:2348:x1875947242497792:12345-192.168.203.17@tcp:38:mount.lustre.0 Request processed in 63383us (63753us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043135.540347:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 4 00000100:00100000:3.0:1789043135.543357:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043135.543404:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043135.543676:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242498048 00000100:00100000:0.0:1789043135.543690:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242498048 00000100:00080000:3.0:1789043135.543838:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789043135.543880:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242497920 00000100:00100000:0.0:1789043135.543884:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242497920 00000100:00100000:0.0:1789043135.543922:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 5 00000100:00100000:0.0:1789043135.543936:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58509587-cde8-42ed-8b49-4691b2633b0c+7:13764:x1875947242498048:12345-192.168.203.17@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789043135.544008:0:14503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789043135.544133:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58509587-cde8-42ed-8b49-4691b2633b0c+7:13764:x1875947242498048:12345-192.168.203.17@tcp:41:mount.lustre.0 Request processed in 199us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043135.544141:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 5 00000100:00100000:3.0:1789043135.544268:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 6 00000100:00100000:3.0:1789043135.544278:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58509587-cde8-42ed-8b49-4691b2633b0c+6:0:x1875947242497920:12345-192.168.203.17@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789043135.544293:0:14502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789043135.544326:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58509587-cde8-42ed-8b49-4691b2633b0c+6:0:x1875947242497920:12345-192.168.203.17@tcp:41:mount.lustre.0 Request processed in 51us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043135.544333:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 6 00000100:00100000:2.0:1789043135.547294:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043135.547395:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242498176 00000100:00100000:3.0:1789043135.547410:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242498176 00000100:00100000:3.0:1789043135.547581:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 7 00000100:00100000:3.0:1789043135.547596:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58509587-cde8-42ed-8b49-4691b2633b0c+6:13764:x1875947242498176:12345-192.168.203.17@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789043135.547727:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58509587-cde8-42ed-8b49-4691b2633b0c+6:13764:x1875947242498176:12345-192.168.203.17@tcp:40:mount.lustre.0 Request processed in 134us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043135.547735:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 7 00000100:00100000:0.0:1789043135.552382:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043135.552460:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043135.552575:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043135.552835:0:14504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242498560 00000100:00100000:3.0:1789043135.552850:0:14504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242498560 00000100:00100000:3.0:1789043135.552917:0:14504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 0 00000100:00100000:3.0:1789043135.552931:0:14504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58509587-cde8-42ed-8b49-4691b2633b0c+6:13764:x1875947242498560:12345-192.168.203.17@tcp:33:mount.lustre.0 00000004:00080000:3.0:1789043135.554098:0:14504:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1048us 00000100:00100000:2.0:1789043135.559274:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242498304 00000100:00100000:2.0:1789043135.559295:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242498304 00000100:00100000:2.0:1789043135.559353:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242498432 00000100:00100000:2.0:1789043135.559357:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242498432 00000100:00100000:2.0:1789043135.559381:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 8 00000100:00100000:2.0:1789043135.559391:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1875947242498304:12345-192.168.203.17@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789043135.559432:0:15185:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 58509587-cde8-42ed-8b49-4691b2633b0c@192.168.203.17@tcp t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:2.0:1789043135.559471:0:15185:0:(genops.c:1393:class_connect()) connect: client 58509587-cde8-42ed-8b49-4691b2633b0c, cookie 0x99260d7389c07295 00002000:00100000:2.0:1789043135.559698:0:15185:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 58509587-cde8-42ed-8b49-4691b2633b0c/ffffa06a52b64000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789043135.559728:0:15185:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789043135.560621:0:15185:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789043135.560757:0:15185:0:(import.c:65:import_set_state_nolock()) ffffa06a52b67000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789043135.560859:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58509587-cde8-42ed-8b49-4691b2633b0c+6:2348:x1875947242498304:12345-192.168.203.17@tcp:8:mount.lustre.0 Request processed in 1465us (8395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043135.560872:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 8 00000100:00100000:2.0:1789043135.560985:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 9 00000100:00100000:2.0:1789043135.560993:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1875947242498432:12345-192.168.203.17@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789043135.563697:0:15185:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 58509587-cde8-42ed-8b49-4691b2633b0c@192.168.203.17@tcp t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:2.0:1789043135.563751:0:15185:0:(genops.c:1393:class_connect()) connect: client 58509587-cde8-42ed-8b49-4691b2633b0c, cookie 0x99260d7389c0729c 00002000:00100000:2.0:1789043135.563773:0:15185:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 58509587-cde8-42ed-8b49-4691b2633b0c/ffffa06a52b63800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789043135.563806:0:15185:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789043135.565246:0:15185:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789043135.565759:0:15185:0:(import.c:65:import_set_state_nolock()) ffffa06a52b60800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789043135.565866:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58509587-cde8-42ed-8b49-4691b2633b0c+6:2348:x1875947242498432:12345-192.168.203.17@tcp:8:mount.lustre.0 Request processed in 4866us (13284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043135.565879:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 9 00000004:00200000:3.0:1789043135.584007:0:14504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789043135.584213:0:14504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58509587-cde8-42ed-8b49-4691b2633b0c+6:13764:x1875947242498560:12345-192.168.203.17@tcp:33:mount.lustre.0 Request processed in 31274us (31835us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043135.584226:0:14504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 0 00000100:00100000:3.0:1789043135.740454:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267660800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789043135.740568:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043135.742186:0:15189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267660800 00000100:00100000:3.0:1789043135.742204:0:15189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267660800 00000100:00100000:3.0:1789043135.742283:0:15189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789043135.742295:0:15189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875947267660800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789043135.742339:0:15189:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789043135.742421:0:15189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875947267660800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (1853us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043135.742429:0:15189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1789043135.742457:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789043135.742507:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267660800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789043135.742627:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ff892c07-94a8-4144-ae30-5a70a83d490b:3315:1875947267660928:0@lo:400:kworker.0 00000100:00100000:3.0:1789043135.742687:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043135.742728:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267660928 00000100:00100000:3.0:1789043135.742732:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267660928 00000100:00100000:3.0:1789043135.742761:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789043135.742767:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+19:3315:x1875947267660928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789043135.742802:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79efe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+19:3315:x1875947267660928:12345-0@lo:400:kworker.0 Request processed in 35us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043135.742809:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789043135.742859:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ff892c07-94a8-4144-ae30-5a70a83d490b:3315:1875947267660928:0@lo:400:kworker.0 00000100:00100000:3.0:1789043135.742903:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267661056:0@lo:400:kworker.0 00000100:00100000:3.0:1789043135.743009:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043135.743056:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267661056 00000100:00100000:3.0:1789043135.743066:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267661056 00000100:00100000:3.0:1789043135.743113:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789043135.743120:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267661056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789043135.743172:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267661056:12345-0@lo:400:kworker.0 Request processed in 53us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043135.743180:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789043135.743195:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789043135.743215:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267661056:0@lo:400:kworker.0 00000100:00100000:3.0:1789043135.743244:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875947267661184:0@lo:400:kworker.0 00000100:00100000:3.0:1789043135.743280:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043135.743313:0:15492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267661184 00000100:00100000:3.0:1789043135.743317:0:15492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267661184 00000100:00100000:3.0:1789043135.743900:0:15492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789043135.743910:0:15492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875947267661184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789043135.743970:0:15492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875947267661184:12345-0@lo:400:kworker.0 Request processed in 61us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043135.743978:0:15492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1789043135.744013:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7a026a00 x1875947267661184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789043151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789043135.744026:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875947267661184:0@lo:400:kworker.0 00000100:00100000:3.0:1789043135.744067:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267661312:0@lo:400:kworker.0 00000100:00100000:3.0:1789043135.744105:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043135.744910:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267661312 00000100:00100000:3.0:1789043135.744919:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267661312 00000100:00100000:3.0:1789043135.744975:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789043135.744984:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267661312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789043135.745044:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267661312:12345-0@lo:400:kworker.0 Request processed in 61us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043135.745051:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1789043135.745074:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789043135.745110:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7a026a00 x1875947267661312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789043151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789043135.745122:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267661312:0@lo:400:kworker.0 00000100:00100000:3.0:1789043135.745246:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875947267661440:0@lo:400:kworker.0 00000100:00100000:3.0:1789043135.745302:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043135.746156:0:15492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267661440 00000100:00100000:3.0:1789043135.746166:0:15492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267661440 00000100:00100000:3.0:1789043135.746653:0:15492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789043135.746665:0:15492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875947267661440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789043135.746760:0:15492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875947267661440:12345-0@lo:400:kworker.0 Request processed in 97us (1456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043135.746769:0:15492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1789043135.746809:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789043135.749057:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa06a7a026a00 x1875947267661440/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789043151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789043135.749091:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875947267661440:0@lo:400:kworker.0 00000100:00100000:0.0:1789043135.810140:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043135.810249:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242498688 00000100:00100000:1.0:1789043135.810262:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242498688 00000100:00100000:1.0:1789043135.810336:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 8 00000100:00100000:1.0:1789043135.810348:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58509587-cde8-42ed-8b49-4691b2633b0c+6:13808:x1875947242498688:12345-192.168.203.17@tcp:101:mkdir.0 00010000:00010000:1.0:1789043135.810376:0:14503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043135.810409:0:14503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c072a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676d13 expref: -99 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043135.810510:0:14503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c072aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043135.810876:0:14503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c072aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043135.810967:0:14503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c072aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789043135.811013:0:14503:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789043135.811017:0:14503:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789043135.811062:0:14503:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c072aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043135.811184:0:14503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687000/0x99260d7389c072a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676d13 expref: 8 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043135.811202:0:14503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c072aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676d13 expref: 7 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043135.811227:0:14503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:1.0:1789043135.811230:0:14503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789043135.811235:0:14503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41686800, rc 0) 00000100:00100000:1.0:1789043135.811433:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58509587-cde8-42ed-8b49-4691b2633b0c+7:13808:x1875947242498688:12345-192.168.203.17@tcp:101:mkdir.0 Request processed in 1085us (1305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043135.811548:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 8 00000001:00100000:0.0:1789043135.845474:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789043135.845987:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 58509587-cde8-42ed-8b49-4691b2633b0c 00000001:00080000:0.0:1789043135.846165:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:3.0:1789043136.117703:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043137.140994:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789043137.818613:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 58509587-cde8-42ed-8b49-4691b2633b0c 00000100:00100000:1.0:1789043137.835706:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043137.835792:0:15492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242498816 00000100:00100000:3.0:1789043137.835807:0:15492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242498816 00000100:00100000:3.0:1789043137.835905:0:15492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 9 00000100:00100000:3.0:1789043137.835918:0:15492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6edb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58509587-cde8-42ed-8b49-4691b2633b0c+7:13860:x1875947242498816:12345-192.168.203.17@tcp:41:lfs.0 00000004:00000024:3.0:1789043137.835977:0:15492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:0.0:1789043137.836171:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789043137.836549:0:15492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6edb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58509587-cde8-42ed-8b49-4691b2633b0c+7:13860:x1875947242498816:12345-192.168.203.17@tcp:41:lfs.0 Request processed in 598us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043137.836560:0:15492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 9 00000100:00100000:2.0:1789043137.845671:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043137.846048:0:15189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242498944 00000100:00100000:3.0:1789043137.846070:0:15189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242498944 00000100:00100000:3.0:1789043137.846284:0:15189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 5 00000100:00100000:3.0:1789043137.846298:0:15189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:58509587-cde8-42ed-8b49-4691b2633b0c+5:13860:x1875947242498944:12345-192.168.203.17@tcp:13:lfs.0 00002000:00000024:3.0:1789043137.846354:0:15189:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789043137.846471:0:15189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:58509587-cde8-42ed-8b49-4691b2633b0c+5:13860:x1875947242498944:12345-192.168.203.17@tcp:13:lfs.0 Request processed in 175us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043137.846479:0:15189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 5 00000100:00080000:0.0:1789043137.849985:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789043137.851592:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043137.851680:0:15189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242499072 00000100:00100000:3.0:1789043137.851707:0:15189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242499072 00000100:00100000:3.0:1789043137.851782:0:15189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 6 00000100:00100000:3.0:1789043137.851794:0:15189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:58509587-cde8-42ed-8b49-4691b2633b0c+5:13860:x1875947242499072:12345-192.168.203.17@tcp:13:lfs.0 00002000:00000024:3.0:1789043137.851856:0:15189:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789043137.851959:0:15189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:58509587-cde8-42ed-8b49-4691b2633b0c+5:13860:x1875947242499072:12345-192.168.203.17@tcp:13:lfs.0 Request processed in 167us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043137.851968:0:15189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 6 00000100:00080000:0.0:1789043137.852380:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789043138.022765:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043138.022917:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242499200 00000100:00100000:0.0:1789043138.022942:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242499200 00000100:00100000:0.0:1789043138.023016:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 91 00000100:00100000:0.0:1789043138.023037:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5996c558-d720-4f58-965c-3a1f4ca9bdac+10:13890:x1875947242499200:12345-192.168.203.17@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789043138.023060:0:14493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789043138.023094:0:14493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa069418ac200/0x99260d7389c072b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676d1a expref: -99 pid: 14493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043138.023132:0:14493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa069418ac200/0x99260d7389c072b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676d1a expref: 11 pid: 14493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043138.023145:0:14493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa069418ac200/0x99260d7389c072b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676d1a expref: 11 pid: 14493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043138.023157:0:14493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa069418ac200, rc 0) 00000100:00100000:0.0:1789043138.023233:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79eff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5996c558-d720-4f58-965c-3a1f4ca9bdac+11:13890:x1875947242499200:12345-192.168.203.17@tcp:101:mount.lustre.0 Request processed in 207us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043138.023248:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 91 00000100:00100000:2.0:1789043138.034767:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043138.034878:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242499328 00000100:00100000:3.0:1789043138.034892:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242499328 00000100:00100000:3.0:1789043138.034959:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 92 00000100:00100000:3.0:1789043138.034971:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5996c558-d720-4f58-965c-3a1f4ca9bdac+11:13890:x1875947242499328:12345-192.168.203.17@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789043138.035948:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5996c558-d720-4f58-965c-3a1f4ca9bdac+11:13890:x1875947242499328:12345-192.168.203.17@tcp:501:mount.lustre.0 Request processed in 970us (1426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043138.035963:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 92 00000100:00100000:2.0:1789043138.044496:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043138.048660:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242499456 00000100:00100000:0.0:1789043138.048683:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242499456 00000100:00100000:0.0:1789043138.048762:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 93 00000100:00100000:0.0:1789043138.048775:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5996c558-d720-4f58-965c-3a1f4ca9bdac+11:13890:x1875947242499456:12345-192.168.203.17@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789043138.051442:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79efe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5996c558-d720-4f58-965c-3a1f4ca9bdac+11:13890:x1875947242499456:12345-192.168.203.17@tcp:503:mount.lustre.0 Request processed in 2653us (7010us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043138.051460:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 93 00000100:00100000:2.0:1789043138.061739:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043138.061957:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242499584 00000100:00100000:1.0:1789043138.061971:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242499584 00000100:00100000:1.0:1789043138.062042:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 94 00000100:00100000:1.0:1789043138.062054:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5996c558-d720-4f58-965c-3a1f4ca9bdac+11:13898:x1875947242499584:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789043138.062488:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79effc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5996c558-d720-4f58-965c-3a1f4ca9bdac+11:13898:x1875947242499584:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 434us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043138.062500:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 94 00000100:00100000:2.0:1789043138.097400:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043138.098684:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242499712 00000100:00100000:0.0:1789043138.098702:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242499712 00000100:00100000:0.0:1789043138.098769:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 95 00000100:00100000:0.0:1789043138.098782:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a79efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5996c558-d720-4f58-965c-3a1f4ca9bdac+11:13898:x1875947242499712:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789043138.099136:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a79efd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5996c558-d720-4f58-965c-3a1f4ca9bdac+11:13898:x1875947242499712:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 355us (1751us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043138.099145:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 95 00000100:00100000:0.0:1789043138.105909:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043138.107627:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242499840 00000100:00100000:2.0:1789043138.107648:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242499840 00000100:00100000:2.0:1789043138.107737:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 96 00000100:00100000:2.0:1789043138.107748:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7b786050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5996c558-d720-4f58-965c-3a1f4ca9bdac+11:13890:x1875947242499840:12345-192.168.203.17@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789043138.107775:0:14495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043138.107809:0:14495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a58605800/0x99260d7389c072b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676d44 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043138.107848:0:14495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a58605800/0x99260d7389c072b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676d44 expref: 12 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043138.107884:0:14495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a58605800/0x99260d7389c072b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676d44 expref: 12 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043138.107896:0:14495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a58605800, rc 0) 00000100:00100000:2.0:1789043138.107986:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7b786050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5996c558-d720-4f58-965c-3a1f4ca9bdac+12:13890:x1875947242499840:12345-192.168.203.17@tcp:101:mount.lustre.0 Request processed in 238us (2089us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043138.107994:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 96 00000100:00100000:2.0:1789043138.116806:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043138.117320:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242499968 00000100:00100000:1.0:1789043138.117334:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242499968 00000100:00100000:1.0:1789043138.117403:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 97 00000100:00100000:1.0:1789043138.117416:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7b784050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5996c558-d720-4f58-965c-3a1f4ca9bdac+12:13890:x1875947242499968:12345-192.168.203.17@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789043138.118223:0:14496:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789043138.118256:0:14496:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789043138.118261:0:14496:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789043138.118265:0:14496:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789043138.118268:0:14496:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1789043138.126104:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7b784050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5996c558-d720-4f58-965c-3a1f4ca9bdac+12:13890:x1875947242499968:12345-192.168.203.17@tcp:256:mount.lustre.0 Request processed in 8674us (9297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043138.126136:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 97 00000100:00100000:0.0:1789043138.130354:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043138.130484:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242500096 00000100:00100000:2.0:1789043138.130497:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242500096 00000100:00100000:2.0:1789043138.130892:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 98 00000100:00100000:2.0:1789043138.130907:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7b786850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5996c558-d720-4f58-965c-3a1f4ca9bdac+12:13890:x1875947242500096:12345-192.168.203.17@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789043138.130931:0:14493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043138.130957:0:14493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a58604c00/0x99260d7389c072bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676d4b expref: -99 pid: 14493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043138.130994:0:14493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a58604c00/0x99260d7389c072bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676d4b expref: 13 pid: 14493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043138.131008:0:14493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a58604c00/0x99260d7389c072bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676d4b expref: 13 pid: 14493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043138.131019:0:14493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a58604c00, rc 0) 00000100:00100000:2.0:1789043138.131105:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7b786850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5996c558-d720-4f58-965c-3a1f4ca9bdac+13:13890:x1875947242500096:12345-192.168.203.17@tcp:101:mount.lustre.0 Request processed in 201us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043138.131113:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 98 00000100:00100000:2.0:1789043138.134763:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043138.134874:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242500224 00000100:00100000:1.0:1789043138.134889:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242500224 00000100:00100000:1.0:1789043138.134962:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 99 00000100:00100000:1.0:1789043138.134974:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7b786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5996c558-d720-4f58-965c-3a1f4ca9bdac+13:13890:x1875947242500224:12345-192.168.203.17@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789043138.135368:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7b786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5996c558-d720-4f58-965c-3a1f4ca9bdac+13:13890:x1875947242500224:12345-192.168.203.17@tcp:501:mount.lustre.0 Request processed in 395us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043138.135376:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 99 00000100:00100000:0.0:1789043138.137989:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043138.138115:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242500352 00000100:00100000:2.0:1789043138.138129:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242500352 00000100:00100000:2.0:1789043138.138245:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 100 00000100:00100000:2.0:1789043138.138262:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7b787850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5996c558-d720-4f58-965c-3a1f4ca9bdac+13:13890:x1875947242500352:12345-192.168.203.17@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789043138.139004:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7b787850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5996c558-d720-4f58-965c-3a1f4ca9bdac+13:13890:x1875947242500352:12345-192.168.203.17@tcp:503:mount.lustre.0 Request processed in 742us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043138.139016:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 100 00000100:00100000:0.0:1789043138.141847:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043138.142233:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242500480 00000100:00100000:3.0:1789043138.142247:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242500480 00000100:00100000:3.0:1789043138.142460:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 101 00000100:00100000:3.0:1789043138.142472:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7b784c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5996c558-d720-4f58-965c-3a1f4ca9bdac+13:13903:x1875947242500480:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789043138.142998:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7b784c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5996c558-d720-4f58-965c-3a1f4ca9bdac+13:13903:x1875947242500480:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 526us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043138.143235:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 101 00000100:00100000:3.0:1789043138.145844:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043138.146119:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242500608 00000100:00100000:2.0:1789043138.146133:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242500608 00000100:00100000:2.0:1789043138.146267:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 102 00000100:00100000:2.0:1789043138.146280:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7b785450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5996c558-d720-4f58-965c-3a1f4ca9bdac+13:13903:x1875947242500608:12345-192.168.203.17@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789043138.146651:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7b785450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5996c558-d720-4f58-965c-3a1f4ca9bdac+13:13903:x1875947242500608:12345-192.168.203.17@tcp:502:llog_process_th.0 Request processed in 371us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043138.146659:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 102 00000100:00100000:0.0:1789043138.150920:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043138.150972:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043138.151001:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043138.151037:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043138.151112:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242501248 00000100:00100000:2.0:1789043138.151128:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242501248 00000100:00100000:2.0:1789043138.151196:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242501376 00000100:00100000:2.0:1789043138.151200:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242501376 00000100:00100000:2.0:1789043138.151224:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 3 00000100:00100000:2.0:1789043138.151235:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58509587-cde8-42ed-8b49-4691b2633b0c+5:2350:x1875947242501248:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1789043138.151261:0:15188:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789043138.151276:0:15188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789043138.151323:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58509587-cde8-42ed-8b49-4691b2633b0c+5:2350:x1875947242501248:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 88us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043138.151333:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 3 00000100:00100000:2.0:1789043138.151354:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 4 00000100:00100000:2.0:1789043138.151368:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58509587-cde8-42ed-8b49-4691b2633b0c+5:2350:x1875947242501376:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1789043138.151413:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58509587-cde8-42ed-8b49-4691b2633b0c+5:2350:x1875947242501376:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 51us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043138.151420:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 4 00000100:00100000:3.0:1789043138.151564:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242500736 00000100:00100000:1.0:1789043138.151564:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242501120 00000100:00100000:3.0:1789043138.151575:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242500736 00000100:00100000:1.0:1789043138.151575:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242501120 00000100:00100000:3.0:1789043138.151617:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 16 00000100:00100000:3.0:1789043138.151631:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58509587-cde8-42ed-8b49-4691b2633b0c+7:2350:x1875947242501120:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1789043138.151710:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58509587-cde8-42ed-8b49-4691b2633b0c+7:2350:x1875947242501120:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 83us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043138.151717:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 16 00000100:00100000:3.0:1789043138.151736:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00100000:3.0:1789043138.151741:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2348:x1875947242500736:12345-192.168.203.17@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789043138.151771:0:14502:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from b857709a-7fd5-4a3a-82ab-b0e6e3c147fd@192.168.203.17@tcp t0 exp 0000000000000000 cur 481 last 0 00000020:00000080:3.0:1789043138.151819:0:14502:0:(genops.c:1393:class_connect()) connect: client b857709a-7fd5-4a3a-82ab-b0e6e3c147fd, cookie 0x99260d7389c072c6 00000004:00100000:3.0:1789043138.151865:0:14502:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789043138.152028:0:14502:0:(import.c:65:import_set_state_nolock()) ffffa06a528cf000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789043138.152090:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+6:2348:x1875947242500736:12345-192.168.203.17@tcp:38:mount.lustre.0 Request processed in 346us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043138.152097:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 10 00010000:00010000:1.0:1789043138.162713:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789043138.166094:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043138.166215:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242500864 00000100:00100000:1.0:1789043138.166228:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242500864 00000100:00100000:1.0:1789043138.166332:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00100000:1.0:1789043138.166345:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+6:0:x1875947242500864:12345-192.168.203.17@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789043138.166408:0:14503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789043138.166501:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+6:0:x1875947242500864:12345-192.168.203.17@tcp:41:mount.lustre.0 Request processed in 158us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043138.166509:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00080000:0.0:1789043138.166933:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789043138.180017:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043138.180158:0:15492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242500992 00000100:00100000:2.0:1789043138.180172:0:15492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242500992 00000100:00100000:2.0:1789043138.180239:0:15492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 12 00000100:00100000:2.0:1789043138.180252:0:15492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+6:13890:x1875947242500992:12345-192.168.203.17@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789043138.180291:0:15492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789043138.180410:0:15492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+6:13890:x1875947242500992:12345-192.168.203.17@tcp:41:mount.lustre.0 Request processed in 160us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043138.180417:0:15492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 12 00000100:00100000:2.0:1789043138.185981:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043138.186414:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242501504 00000100:00100000:0.0:1789043138.186427:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242501504 00000100:00100000:0.0:1789043138.186783:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 13 00000100:00100000:0.0:1789043138.186797:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+6:13890:x1875947242501504:12345-192.168.203.17@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789043138.186950:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+6:13890:x1875947242501504:12345-192.168.203.17@tcp:40:mount.lustre.0 Request processed in 156us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043138.186958:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 13 00000100:00100000:0.0:1789043138.192845:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043138.192883:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043138.192964:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043138.193162:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242501632 00000100:00100000:3.0:1789043138.193175:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242501632 00000100:00100000:3.0:1789043138.193218:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242501760 00000100:00100000:3.0:1789043138.193221:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242501760 00000100:00100000:3.0:1789043138.193242:0:15188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00100000:3.0:1789043138.193251:0:15188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1875947242501632:12345-192.168.203.17@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789043138.193295:0:15188:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from b857709a-7fd5-4a3a-82ab-b0e6e3c147fd@192.168.203.17@tcp t0 exp 0000000000000000 cur 481 last 0 00000020:00000080:3.0:1789043138.193339:0:15188:0:(genops.c:1393:class_connect()) connect: client b857709a-7fd5-4a3a-82ab-b0e6e3c147fd, cookie 0x99260d7389c072cd 00002000:00100000:3.0:1789043138.193355:0:15188:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b857709a-7fd5-4a3a-82ab-b0e6e3c147fd/ffffa06a528cf800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789043138.193374:0:15188:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789043138.193711:0:15188:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789043138.193754:0:15188:0:(import.c:65:import_set_state_nolock()) ffffa06a528c9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789043138.193857:0:15188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+6:2348:x1875947242501632:12345-192.168.203.17@tcp:8:mount.lustre.0 Request processed in 606us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043138.193865:0:15188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00100000:3.0:1789043138.193883:0:15188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00100000:3.0:1789043138.193888:0:15188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1875947242501760:12345-192.168.203.17@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789043138.193902:0:15188:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from b857709a-7fd5-4a3a-82ab-b0e6e3c147fd@192.168.203.17@tcp t0 exp 0000000000000000 cur 481 last 0 00000020:00000080:3.0:1789043138.193933:0:15188:0:(genops.c:1393:class_connect()) connect: client b857709a-7fd5-4a3a-82ab-b0e6e3c147fd, cookie 0x99260d7389c072d4 00002000:00100000:3.0:1789043138.193939:0:15188:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b857709a-7fd5-4a3a-82ab-b0e6e3c147fd/ffffa06a7a029000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789043138.193945:0:15188:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789043138.194078:0:15188:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789043138.194092:0:15188:0:(import.c:65:import_set_state_nolock()) ffffa06a7a02a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789043138.194113:0:15188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+6:2348:x1875947242501760:12345-192.168.203.17@tcp:8:mount.lustre.0 Request processed in 224us (1148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043138.194119:0:15188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00100000:1.0:1789043138.194460:0:14505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242501888 00000100:00100000:1.0:1789043138.194467:0:14505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242501888 00000100:00100000:1.0:1789043138.194508:0:14505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 1 00000100:00100000:1.0:1789043138.194549:0:14505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+6:13890:x1875947242501888:12345-192.168.203.17@tcp:33:mount.lustre.0 00000004:00200000:1.0:1789043138.194632:0:14505:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789043138.194693:0:14505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+6:13890:x1875947242501888:12345-192.168.203.17@tcp:33:mount.lustre.0 Request processed in 178us (1861us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043138.194713:0:14505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 1 00000100:00100000:0.0:1789043138.327389:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043138.327552:0:15492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242502016 00000100:00100000:2.0:1789043138.327566:0:15492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242502016 00000100:00100000:2.0:1789043138.327637:0:15492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 14 00000100:00100000:2.0:1789043138.327649:0:15492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+6:13925:x1875947242502016:12345-192.168.203.17@tcp:101:mkdir.0 00010000:00010000:2.0:1789043138.327676:0:15492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043138.327704:0:15492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605e00/0x99260d7389c072db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676d75 expref: -99 pid: 15492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043138.327789:0:15492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605a00/0x99260d7389c072e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043138.327806:0:15492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605a00/0x99260d7389c072e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043138.327824:0:15492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605a00/0x99260d7389c072e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789043138.327881:0:15492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789043138.327886:0:15492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789043138.327912:0:15492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605a00/0x99260d7389c072e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043138.327942:0:15492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605e00/0x99260d7389c072db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676d75 expref: 8 pid: 15492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043138.327963:0:15492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605a00/0x99260d7389c072e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676d75 expref: 7 pid: 15492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043138.327972:0:15492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:2.0:1789043138.327976:0:15492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789043138.327980:0:15492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a58605a00, rc 0) 00000100:00100000:2.0:1789043138.328158:0:15492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+7:13925:x1875947242502016:12345-192.168.203.17@tcp:101:mkdir.0 Request processed in 510us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043138.328165:0:15492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 14 00000100:00100000:0.0:1789043138.802804:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789043138.810876:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267661568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789043138.810980:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043138.811611:0:15189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267661568 00000100:00100000:3.0:1789043138.811624:0:15189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267661568 00000100:00100000:3.0:1789043138.811705:0:15189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789043138.811717:0:15189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267661568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789043138.811753:0:15189:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789043138.811838:0:15189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267661568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043138.811846:0:15189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789043138.812135:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267661568:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789043138.812267:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789043139.189013:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043140.210998:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789043140.533268:0:14533:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789043140.850688:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789043140.850721:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267661696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789043140.850820:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043140.850906:0:15189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267661696 00000100:00100000:3.0:1789043140.850916:0:15189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267661696 00000100:00080000:0.0:1789043140.851285:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789043140.851301:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff892c07-94a8-4144-ae30-5a70a83d490b:3314:1875947267661824:0@lo:400:kworker.0 00000100:00100000:0.0:1789043140.851345:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043140.851373:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875947267662336:0@lo:400:kworker.0 00000100:00100000:0.0:1789043140.851403:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043140.851438:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789043140.851444:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267661952:0@lo:400:kworker.0 00000100:00100000:0.0:1789043140.851472:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043140.851507:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267661824 00000100:00100000:0.0:1789043140.851536:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267661824 00000100:00100000:0.0:1789043140.851575:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789043140.851586:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7b786c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+19:3314:x1875947267661824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789043140.851654:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7b786c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+19:3314:x1875947267661824:12345-0@lo:400:kworker.0 Request processed in 69us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043140.851662:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789043140.851704:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267662336 00000100:00100000:0.0:1789043140.851708:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267662336 00000100:00100000:0.0:1789043140.851744:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789043140.851751:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875947267662336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789043140.851787:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875947267662336:12345-0@lo:400:kworker.0 Request processed in 36us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043140.851794:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789043140.851814:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267661952 00000100:00100000:0.0:1789043140.851818:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267661952 00000100:00100000:0.0:1789043140.851847:0:15188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789043140.851854:0:15188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267661952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789043140.851885:0:15188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267661952:12345-0@lo:400:kworker.0 Request processed in 32us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043140.851892:0:15188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1789043140.851919:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789043140.851937:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789043140.851971:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267661952:0@lo:400:kworker.0 00000100:00100000:0.0:1789043140.851981:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff892c07-94a8-4144-ae30-5a70a83d490b:3314:1875947267661824:0@lo:400:kworker.0 00000100:00100000:0.0:1789043140.851991:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875947267662336:0@lo:400:kworker.0 00000100:00100000:0.0:1789043140.852018:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875947267662080:0@lo:400:kworker.0 00000100:00100000:0.0:1789043140.852059:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043140.852082:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789043140.852095:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875947267662208:0@lo:400:kworker.0 00000100:00100000:3.0:1789043140.852227:0:15189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789043140.852237:0:15189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267661696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789043140.852274:0:15189:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789043140.852315:0:15189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875947267661696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043140.852322:0:15189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789043140.853702:0:15492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267662080 00000100:00100000:3.0:1789043140.853718:0:15492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267662080 00000100:00100000:3.0:1789043140.853770:0:15492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789043140.853780:0:15492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875947267662080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789043140.853866:0:15492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875947267662080:12345-0@lo:400:kworker.0 Request processed in 88us (1806us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043140.853874:0:15492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789043140.855504:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043140.855610:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875947267662080:0@lo:400:kworker.0 00000100:00100000:0.0:1789043140.855635:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1789043140.855666:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875947267661696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789043140.858287:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267662208 00000100:00100000:3.0:1789043140.858307:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267662208 00000100:00100000:3.0:1789043140.858398:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789043140.858409:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875947267662208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789043140.858556:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875947267662208:12345-0@lo:400:kworker.0 Request processed in 149us (3062us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043140.858564:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1789043140.858738:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789043140.864746:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875947267662208:0@lo:400:kworker.0 00000001:00100000:0.0:1789043140.907129:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 58509587-cde8-42ed-8b49-4691b2633b0c 00000001:00100000:0.0:1789043140.907151:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b857709a-7fd5-4a3a-82ab-b0e6e3c147fd 00000001:00100000:1.0:1789043140.950827:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b857709a-7fd5-4a3a-82ab-b0e6e3c147fd 00000001:02000400:2.0:1789043141.232651:0:16463:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789043141.234854:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789043142.261639:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789043142.983871:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b857709a-7fd5-4a3a-82ab-b0e6e3c147fd 00010000:00010000:2.0:1789043143.283987:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789043143.376592:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043143.376635:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043143.376655:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043143.376679:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043143.376701:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043143.376716:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043143.376735:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043143.376760:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242502400 00000100:00100000:1.0:1789043143.376768:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242502400 00000100:00100000:1.0:1789043143.376817:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242502912 00000100:00100000:1.0:1789043143.376820:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242502912 00000100:00100000:1.0:1789043143.376836:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242502528 00000100:00100000:1.0:1789043143.376838:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242502528 00000100:00100000:1.0:1789043143.376849:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242502784 00000100:00100000:1.0:1789043143.376850:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242502784 00000100:00100000:1.0:1789043143.376862:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 6 00000100:00100000:1.0:1789043143.376871:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6edbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58509587-cde8-42ed-8b49-4691b2633b0c+5:2351:x1875947242502400:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1789043143.377090:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242502144 00000100:00100000:2.0:1789043143.377096:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242502144 00000100:00100000:2.0:1789043143.377124:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 104 00000100:00100000:2.0:1789043143.377131:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7b787c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5996c558-d720-4f58-965c-3a1f4ca9bdac+13:2351:x1875947242502144:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:2.0:1789043143.377200:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7b787c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5996c558-d720-4f58-965c-3a1f4ca9bdac+13:2351:x1875947242502144:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 69us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043143.377207:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 104 00000100:00100000:0.0:1789043143.377315:0:16375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 7 00000100:00100000:0.0:1789043143.377325:0:16375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6edb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+5:2351:x1875947242502912:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1789043143.377354:0:16375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6edb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+5:2351:x1875947242502912:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 32us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043143.377360:0:16375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 7 00000100:00100000:0.0:1789043143.377373:0:16375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 8 00000100:00100000:0.0:1789043143.377378:0:16375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6edb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58509587-cde8-42ed-8b49-4691b2633b0c+5:2352:x1875947242502528:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1789043143.377398:0:16375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6edb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58509587-cde8-42ed-8b49-4691b2633b0c+5:2352:x1875947242502528:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 20us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043143.377403:0:16375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 8 00000100:00100000:0.0:1789043143.377412:0:16375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 9 00000100:00100000:0.0:1789043143.377417:0:16375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+5:2352:x1875947242502784:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:0.0:1789043143.377435:0:16375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+5:2352:x1875947242502784:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 18us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043143.377451:0:16375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 9 00000100:00080000:0.0:1789043143.377729:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789043143.377734:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789043143.378218:0:15492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242502656 00000100:00100000:3.0:1789043143.378225:0:15492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242502656 00000100:00100000:3.0:1789043143.378284:0:15492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242502272 00000100:00100000:3.0:1789043143.378288:0:15492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242502272 00000100:00100000:3.0:1789043143.378309:0:15492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 20 00000100:00100000:3.0:1789043143.378327:0:15492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6edbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+6:2351:x1875947242502656:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1789043143.378375:0:15492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6edbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+6:2351:x1875947242502656:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 51us (1719us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043143.378381:0:15492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 20 00000100:00100000:3.0:1789043143.378394:0:15492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 21 00000100:00100000:3.0:1789043143.378401:0:15492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6edb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58509587-cde8-42ed-8b49-4691b2633b0c+6:2352:x1875947242502272:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1789043143.378428:0:15492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6edb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58509587-cde8-42ed-8b49-4691b2633b0c+6:2352:x1875947242502272:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 27us (1725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043143.378434:0:15492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 21 00000100:00080000:0.0:1789043143.382077:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789043143.382160:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6edbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58509587-cde8-42ed-8b49-4691b2633b0c+5:2351:x1875947242502400:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 5282us (5516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043143.382173:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 6 00000100:00100000:1.0:1789043143.922891:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789043143.922925:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267662464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789043143.922999:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043143.923205:0:15189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267662464 00000100:00100000:3.0:1789043143.923213:0:15189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267662464 00000100:00100000:3.0:1789043143.923283:0:15189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789043143.923293:0:15189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267662464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789043143.923327:0:15189:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789043143.923378:0:15189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267662464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043143.923384:0:15189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1789043143.923510:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789043143.923600:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267662464:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789043144.309414:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789043144.517073:0:16611:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffe6757110 20000000:00000080:1.0:1789043144.517088:0:16611:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa06941399800 uarg=0000000000000000 20000000:01000000:1.0:1789043144.517122:0:16611:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789043144.517127:0:16611:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789043144.517132:0:16611:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789043144.517952:0:16612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1789043144.518112:0:16611:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789043144.523439:0:16611:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789043144.523470:0:16611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa06a41686000/0x99260d7389c072e9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043144.523489:0:16611:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a7fa6f800/0x99260d7389c06fe0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c06fd9 expref: 18 pid: 14493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043144.523498:0:16611:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a7fa6ec00/0x99260d7389c0702d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c07026 expref: 18 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043144.523505:0:16611:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa069418ad000/0x99260d7389c07168 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c07161 expref: 18 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043144.523542:0:16611:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a41686200/0x99260d7389c07287 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ce9 expref: 12 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043144.523550:0:16611:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa06a58604c00/0x99260d7389c072bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676d4b expref: 12 pid: 14493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043144.523557:0:16611:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa06a41686000/0x99260d7389c072e9 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043144.523605:0:16611:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a58604c00/0x99260d7389c072bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676d4b expref: 12 pid: 14493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043144.523641:0:16611:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa06a58604c00/0x99260d7389c072bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676d4b expref: 12 pid: 14493 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043144.523657:0:16611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f837800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16611:1875947267662592:192.168.203.17@tcp:104: 00010000:00010000:1.0:1789043144.523760:0:16611:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a41686200/0x99260d7389c07287 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ce9 expref: 12 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043144.523769:0:16611:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa06a41686200/0x99260d7389c07287 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ce9 expref: 12 pid: 14496 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043144.523777:0:16611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f837100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16611:1875947267662720:192.168.203.17@tcp:104: 00010000:00010000:1.0:1789043144.523808:0:16611:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa069418ad000/0x99260d7389c07168 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99260d7389c07161 expref: 18 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043144.523816:0:16611:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa069418ad000/0x99260d7389c07168 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99260d7389c07161 expref: 18 pid: 14496 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043144.523825:0:16611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f834380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16611:1875947267662848:0@lo:104: 00000100:00100000:1.0:1789043144.524226:0:16611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789043144.524345:0:16611:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a7fa6ec00/0x99260d7389c0702d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99260d7389c07026 expref: 18 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043144.524354:0:16611:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa06a7fa6ec00/0x99260d7389c0702d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99260d7389c07026 expref: 18 pid: 14495 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043144.524363:0:16611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f835880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16611:1875947267662976:0@lo:104: 00000100:00100000:1.0:1789043144.524385:0:16611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043144.527307:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043144.527333:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00010000:00010000:1.0:1789043144.527428:0:16611:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa06a7fa6f800/0x99260d7389c06fe0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99260d7389c06fd9 expref: 18 pid: 14493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043144.527452:0:16611:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa06a7fa6f800/0x99260d7389c06fe0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99260d7389c06fd9 expref: 18 pid: 14493 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043144.527466:0:16611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f835c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16611:1875947267663104:0@lo:104: 00000100:00100000:1.0:1789043144.527511:0:16611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043144.527801:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267662848 00000100:00100000:0.0:1789043144.527809:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267662848 00000100:00100000:0.0:1789043144.527847:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267662976 00000100:00100000:0.0:1789043144.527850:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267662976 00000100:00100000:3.0:1789043144.527860:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242503168 00000100:00100000:3.0:1789043144.527864:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242503168 00000100:00100000:0.0:1789043144.527865:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789043144.527873:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f835f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff892c07-94a8-4144-ae30-5a70a83d490b+4:16611:x1875947267662848:12345-0@lo:104: 00010000:00010000:3.0:1789043144.527883:0:14488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a41686200/0x99260d7389c07287 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ce9 expref: 13 pid: 14496 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043144.527884:0:14485:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffffa06a50978e00/0x99260d7389c07161 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c07168 expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043144.527903:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242503040 00000100:00100000:3.0:1789043144.527905:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242503040 00010000:00010000:3.0:1789043144.527915:0:14488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a58604c00/0x99260d7389c072bf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676d4b expref: 14 pid: 14493 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043144.527929:0:14485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789043144.527934:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f835f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff892c07-94a8-4144-ae30-5a70a83d490b+4:16611:x1875947267662848:12345-0@lo:104: Request processed in 62us (3709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043144.527941:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789043144.527945:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 4 00000100:00100000:0.0:1789043144.527955:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789043144.527961:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f837b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff892c07-94a8-4144-ae30-5a70a83d490b+3:16611:x1875947267662976:12345-0@lo:104: 00010000:00010000:0.0:1789043144.527969:0:14485:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28200/0x99260d7389c07026 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c0702d expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043144.528001:0:14485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789043144.528006:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f837b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff892c07-94a8-4144-ae30-5a70a83d490b+3:16611:x1875947267662976:12345-0@lo:104: Request processed in 46us (3621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043144.528015:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75ede300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5996c558-d720-4f58-965c-3a1f4ca9bdac+14:2351:x1875947242503168:12345-192.168.203.17@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1789043144.528030:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1789043144.528035:0:14488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789043144.528040:0:14488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a41686200/0x99260d7389c07287 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ce9 expref: 14 pid: 14496 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043144.528051:0:14488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a41686200/0x99260d7389c07287 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ce9 expref: 14 pid: 14496 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043144.528068:0:14488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789043144.528102:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75ede300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5996c558-d720-4f58-965c-3a1f4ca9bdac+14:2351:x1875947242503168:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 87us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043144.528108:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 4 00000100:00100000:3.0:1789043144.528121:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 5 00000100:00100000:3.0:1789043144.528126:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75edd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5996c558-d720-4f58-965c-3a1f4ca9bdac+13:2351:x1875947242503040:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789043144.528133:0:14488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789043144.528137:0:14488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a58604c00/0x99260d7389c072bf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676d4b expref: 13 pid: 14493 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043144.528145:0:14488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a58604c00/0x99260d7389c072bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676d4b expref: 13 pid: 14493 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043144.528154:0:14488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789043144.528170:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75edd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5996c558-d720-4f58-965c-3a1f4ca9bdac+13:2351:x1875947242503040:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 44us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043144.528176:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 5 00010000:00010000:3.0:1789043144.528200:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789043144.528206:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a50978e00/0x99260d7389c07161 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c07168 expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043144.528213:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a50978e00 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:3.0:1789043144.528217:0:14490:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a50978e00/0x99260d7389c07161 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x99260d7389c07168 expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043144.528226:0:14490:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a50978e00/0x99260d7389c07161 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x99260d7389c07168 expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789043144.528233:0:14490:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a50978e00/0x99260d7389c07161 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x99260d7389c07168 expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789043144.528239:0:14490:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789043144.528510:0:14490:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a50978e00/0x99260d7389c07161 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c07168 expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043144.528530:0:14490:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789043144.528613:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a50978e00/0x99260d7389c07161 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c07168 expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043144.528620:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a50978e00/0x99260d7389c07161 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c07168 expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043144.528634:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789043144.529029:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28200/0x99260d7389c07026 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c0702d expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043144.529036:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc28200 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:3.0:1789043144.529040:0:14490:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28200/0x99260d7389c07026 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x99260d7389c0702d expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043144.529054:0:14490:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28200/0x99260d7389c07026 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x99260d7389c0702d expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789043144.529061:0:14490:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28200/0x99260d7389c07026 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x99260d7389c0702d expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789043144.529067:0:14490:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789043144.529088:0:14490:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28200/0x99260d7389c07026 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c0702d expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043144.529094:0:14490:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789043144.529100:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28200/0x99260d7389c07026 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c0702d expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043144.529107:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a6fc28200/0x99260d7389c07026 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c0702d expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043144.529118:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043144.529120:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043144.529121:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789043144.529136:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff892c07-94a8-4144-ae30-5a70a83d490b:3312:1875947267663232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789043144.529173:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043144.529208:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789043144.529213:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7a027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff892c07-94a8-4144-ae30-5a70a83d490b:3312:1875947267663360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789043144.529230:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043144.529252:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267663232 00000100:00100000:3.0:1789043144.529256:0:14487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267663232 00010000:00010000:3.0:1789043144.529340:0:14487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa069418ad000/0x99260d7389c07168 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c07161 expref: 19 pid: 14496 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043144.529423:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267663360 00000100:00100000:3.0:1789043144.529426:0:14487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267663360 00010000:00010000:3.0:1789043144.529436:0:14487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a7fa6ec00/0x99260d7389c0702d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c07026 expref: 20 pid: 14495 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043144.529447:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789043144.529453:0:14487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5244a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ff892c07-94a8-4144-ae30-5a70a83d490b+20:3312:x1875947267663232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789043144.529463:0:14487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789043144.529467:0:14487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa069418ad000/0x99260d7389c07168 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c07161 expref: 20 pid: 14496 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043144.529477:0:14487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa069418ad000/0x99260d7389c07168 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99260d7389c07161 expref: 20 pid: 14496 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043144.529489:0:14487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789043144.529594:0:14487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5244a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ff892c07-94a8-4144-ae30-5a70a83d490b+20:3312:x1875947267663232:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043144.529601:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789043144.529845:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789043144.529852:0:14487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ff892c07-94a8-4144-ae30-5a70a83d490b+19:3312:x1875947267663360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789043144.529859:0:14487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789043144.529864:0:14487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a7fa6ec00/0x99260d7389c0702d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c07026 expref: 19 pid: 14495 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043144.529873:0:14487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a7fa6ec00/0x99260d7389c0702d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99260d7389c07026 expref: 19 pid: 14495 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043144.529882:0:14487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789043144.529908:0:14487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ff892c07-94a8-4144-ae30-5a70a83d490b+19:3312:x1875947267663360:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043144.529914:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789043144.530030:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff892c07-94a8-4144-ae30-5a70a83d490b:3312:1875947267663360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789043144.530040:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7a026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff892c07-94a8-4144-ae30-5a70a83d490b:3312:1875947267663232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789043144.531371:0:16611:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a585aee40 going to sleep for 11 seconds 00010000:00010000:1.0:1789043144.531397:0:16611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a58604c00/0x99260d7389c072bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676d4b expref: 12 pid: 14493 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043144.531412:0:16611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f837800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16611:1875947267662592:192.168.203.17@tcp:104: 00010000:00010000:1.0:1789043144.531425:0:16611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a41686200/0x99260d7389c07287 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676ce9 expref: 11 pid: 14496 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043144.531434:0:16611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f837100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16611:1875947267662720:192.168.203.17@tcp:104: 00000100:00100000:0.0:1789043144.531475:0:14485:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789043144.531490:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267663104 00000100:00100000:0.0:1789043144.531496:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267663104 00010000:00010000:2.0:1789043144.531599:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789043144.531619:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789043144.531629:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a77042450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff892c07-94a8-4144-ae30-5a70a83d490b+3:16611:x1875947267663104:12345-0@lo:104: 00010000:00010000:1.0:1789043144.531692:0:16611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa069418ad000/0x99260d7389c07168 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99260d7389c07161 expref: 18 pid: 14496 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043144.531701:0:16611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f834380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16611:1875947267662848:0@lo:104: 00010000:00010000:1.0:1789043144.531711:0:16611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a7fa6ec00/0x99260d7389c0702d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99260d7389c07026 expref: 17 pid: 14495 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043144.531718:0:16611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f835880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16611:1875947267662976:0@lo:104: 00010000:00010000:0.0:1789043144.531878:0:14485:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6f000/0x99260d7389c06fd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c06fe0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043144.532005:0:16611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f835c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16611:1875947267663104:0@lo:104: 00010000:00010000:1.0:1789043144.532048:0:16611:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa06a41686000/0x99260d7389c072e9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043144.532099:0:14485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789043144.532105:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a77042450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff892c07-94a8-4144-ae30-5a70a83d490b+3:16611:x1875947267663104:12345-0@lo:104: Request processed in 479us (4594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043144.532112:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1789043144.532289:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789043144.532295:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6f000/0x99260d7389c06fd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99260d7389c06fe0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043144.532302:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a7fa6f000 already unused, calling callback (ffffffffc1a58c20) 10000000:00010000:3.0:1789043144.532306:0:14490:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6f000/0x99260d7389c06fd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x99260d7389c06fe0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043144.532314:0:14490:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6f000/0x99260d7389c06fd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x99260d7389c06fe0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789043144.532320:0:14490:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6f000/0x99260d7389c06fd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x99260d7389c06fe0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789043144.532325:0:14490:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789043144.532410:0:14490:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6f000/0x99260d7389c06fd9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c06fe0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043144.532416:0:14490:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789043144.532455:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6f000/0x99260d7389c06fd9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c06fe0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043144.532461:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.117@tcp lock: ffffa06a7fa6f000/0x99260d7389c06fd9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99260d7389c06fe0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043144.532486:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043144.532487:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789043144.532489:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789043144.532827:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789043144.532843:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ff892c07-94a8-4144-ae30-5a70a83d490b:3315:1875947267663488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789043144.532885:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043144.532925:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267663488 00000100:00100000:2.0:1789043144.532930:0:14487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267663488 00010000:00010000:2.0:1789043144.532951:0:14487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa06a7fa6f800/0x99260d7389c06fe0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c06fd9 expref: 17 pid: 14493 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043144.532977:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789043144.532985:0:14487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ff892c07-94a8-4144-ae30-5a70a83d490b+17:3315:x1875947267663488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789043144.532995:0:14487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789043144.533000:0:14487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa06a7fa6f800/0x99260d7389c06fe0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99260d7389c06fd9 expref: 17 pid: 14493 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043144.533011:0:14487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa06a7fa6f800/0x99260d7389c06fe0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99260d7389c06fd9 expref: 17 pid: 14493 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043144.533033:0:14487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a7fa6f800/0x99260d7389c06fe0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99260d7389c06fd9 expref: 17 pid: 14493 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043144.533046:0:14487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa06a41686000/0x99260d7389c072e9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043144.533062:0:14487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a41686000/0x99260d7389c072e9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043144.533076:0:14487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa06a41686000/0x99260d7389c072e9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043144.533083:0:14487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa06a41686000/0x99260d7389c072e9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043144.533090:0:14487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa06a41686000/0x99260d7389c072e9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043144.533095:0:14487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa06a41686000/0x99260d7389c072e9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043144.533100:0:14487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686000 already unused, calling callback (ffffffffc1470760) 00010000:00010000:2.0:1789043144.533104:0:14487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa06a41686000/0x99260d7389c072e9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043144.533111:0:14487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa06a41686000/0x99260d7389c072e9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043144.533130:0:14487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa06a41686000/0x99260d7389c072e9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043144.533139:0:14487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789043144.533151:0:16611:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa06a41686000/0x99260d7389c072e9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043144.533161:0:16611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa06a41686000/0x99260d7389c072e9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043144.533168:0:16611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa06a41686000/0x99260d7389c072e9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043144.533170:0:14487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ff892c07-94a8-4144-ae30-5a70a83d490b+16:3315:x1875947267663488:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043144.533184:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789043144.533218:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ff892c07-94a8-4144-ae30-5a70a83d490b:3315:1875947267663488:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789043145.335001:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789043145.842620:0:14499:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789043145.842627:0:14499:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa06a75ed5800 from 10 10000000:01000000:0.0:1789043145.842633:0:14499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789043145.842682:0:14499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa069418ad600/0x99260d7389c072f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043145.842694:0:14499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa069418ad600/0x99260d7389c072f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043145.842708:0:14499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa069418ad600/0x99260d7389c072f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043145.842738:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff892c07-94a8-4144-ae30-5a70a83d490b:14499:1875947267663616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789043145.842810:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043145.842865:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a454a73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789043145.845240:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267663616 00000100:00100000:1.0:1789043145.845255:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267663616 00000100:00100000:1.0:1789043145.845323:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789043145.845333:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7b784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+16:14499:x1875947267663616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789043145.845350:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043145.845371:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a41686200/0x99260d7389c072f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c072f0 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043145.845400:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a41686200/0x99260d7389c072f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c072f0 expref: 17 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043145.845411:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a41686200/0x99260d7389c072f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c072f0 expref: 17 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043145.845420:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41686200, rc 0) 00000100:00100000:1.0:1789043145.845485:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7b784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+17:14499:x1875947267663616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (2674us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043145.845491:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789043145.845671:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff892c07-94a8-4144-ae30-5a70a83d490b:14499:1875947267663616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789043145.845705:0:14499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa069418ad600/0x99260d7389c072f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c072f7 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043145.845715:0:14499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa069418ad600/0x99260d7389c072f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c072f7 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043145.845785:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff892c07-94a8-4144-ae30-5a70a83d490b:14499:1875947267663744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789043145.845818:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043145.845859:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a454a73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789043145.846200:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267663744 00000100:00100000:1.0:1789043145.846215:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267663744 00000100:00100000:1.0:1789043145.846250:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789043145.846259:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a76599050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+17:14499:x1875947267663744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789043145.846554:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a76599050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+17:14499:x1875947267663744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 295us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043145.846562:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789043145.846642:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff892c07-94a8-4144-ae30-5a70a83d490b:14499:1875947267663744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789043145.846677:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff892c07-94a8-4144-ae30-5a70a83d490b:14499:1875947267663872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789043145.846717:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043145.846747:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a50a62000 going to sleep for 11 seconds 00000100:00100000:1.0:1789043145.846793:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267663872 00000100:00100000:1.0:1789043145.846797:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267663872 00000100:00100000:1.0:1789043145.846816:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789043145.846822:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7659b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+17:14499:x1875947267663872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789043145.847069:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7659b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+17:14499:x1875947267663872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 246us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043145.847076:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789043145.852094:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff892c07-94a8-4144-ae30-5a70a83d490b:14499:1875947267663872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789043145.853712:0:16679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789043145.854433:0:14499:0:(obd_config.c:2243:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789043145.854460:0:14499:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789043145.854470:0:14499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa069418ad600/0x99260d7389c072f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c072f7 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043145.854682:0:14499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa069418ad600/0x99260d7389c072f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c072f7 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789043145.854693:0:14499:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789043145.854696:0:14499:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa06a763bb000 from 10 10000000:01000000:2.0:1789043145.854699:0:14499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789043145.854736:0:14499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c072fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043145.854885:0:14499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c072fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043145.854896:0:14499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c072fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043145.854923:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75edd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff892c07-94a8-4144-ae30-5a70a83d490b:14499:1875947267664000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789043145.854989:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043145.855088:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a52c30300 going to sleep for 11 seconds 00000100:00100000:0.0:1789043145.855131:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267664000 00000100:00100000:0.0:1789043145.855139:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267664000 00000100:00100000:0.0:1789043145.855327:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789043145.855339:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7659b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+17:14499:x1875947267664000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789043145.855353:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789043145.855366:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa069418ada00/0x99260d7389c07305 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c072fe expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043145.855390:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa069418ada00/0x99260d7389c07305 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c072fe expref: 18 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043145.855401:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa069418ada00/0x99260d7389c07305 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c072fe expref: 18 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043145.855409:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa069418ada00, rc 0) 00000100:00100000:0.0:1789043145.855458:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7659b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff892c07-94a8-4144-ae30-5a70a83d490b+18:14499:x1875947267664000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043145.855465:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789043145.855559:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75edd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff892c07-94a8-4144-ae30-5a70a83d490b:14499:1875947267664000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789043145.855573:0:14499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c072fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c07305 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043145.855582:0:14499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c072fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c07305 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043145.855651:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75edd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff892c07-94a8-4144-ae30-5a70a83d490b:14499:1875947267664128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789043145.855677:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789043145.856052:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a52c30300 going to sleep for 11 seconds 00000100:00100000:1.0:1789043145.856119:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267664128 00000100:00100000:1.0:1789043145.856124:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267664128 00000100:00100000:1.0:1789043145.856149:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789043145.856156:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7659ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+18:14499:x1875947267664128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789043145.856405:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7659ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+18:14499:x1875947267664128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043145.856412:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789043145.856486:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75edd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff892c07-94a8-4144-ae30-5a70a83d490b:14499:1875947267664128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789043145.856545:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff892c07-94a8-4144-ae30-5a70a83d490b:14499:1875947267664256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789043145.856585:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043145.856606:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a50a62540 going to sleep for 11 seconds 00000100:00100000:1.0:1789043145.856734:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267664256 00000100:00100000:1.0:1789043145.856750:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267664256 00000100:00100000:1.0:1789043145.856776:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789043145.856783:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7659a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+18:14499:x1875947267664256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789043145.856927:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7659a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+18:14499:x1875947267664256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043145.856942:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789043145.857082:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff892c07-94a8-4144-ae30-5a70a83d490b:14499:1875947267664256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789043145.858158:0:16680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789043145.858328:0:14499:0:(obd_config.c:2243:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789043145.858349:0:14499:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789043145.858358:0:14499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c072fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c07305 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043145.858370:0:14499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a58604400/0x99260d7389c072fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c07305 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789043145.858379:0:14499:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789043145.858382:0:14499:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa06a7f846000 from 10 10000000:01000000:1.0:1789043145.858384:0:14499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789043145.858416:0:14499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41687000/0x99260d7389c0730c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043145.858424:0:14499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.117@tcp lock: ffffa06a41687000/0x99260d7389c0730c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043145.858434:0:14499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.117@tcp lock: ffffa06a41687000/0x99260d7389c0730c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043145.858453:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f835c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff892c07-94a8-4144-ae30-5a70a83d490b:14499:1875947267664384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789043145.858540:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043145.858577:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a58531600 going to sleep for 11 seconds 00000100:00100000:3.0:1789043145.858696:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267664384 00000100:00100000:3.0:1789043145.858702:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267664384 00000100:00100000:3.0:1789043145.858729:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789043145.858746:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7659a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+18:14499:x1875947267664384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789043145.858760:0:14495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789043145.858773:0:14495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a6fc28200/0x99260d7389c07313 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x99260d7389c0730c expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043145.858815:0:14495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a6fc28200/0x99260d7389c07313 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99260d7389c0730c expref: 19 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043145.858826:0:14495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a6fc28200/0x99260d7389c07313 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99260d7389c0730c expref: 19 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043145.858834:0:14495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc28200, rc 0) 00000100:00100000:3.0:1789043145.858868:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7659a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+19:14499:x1875947267664384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043145.858874:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789043145.859057:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f835c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff892c07-94a8-4144-ae30-5a70a83d490b:14499:1875947267664384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789043145.859072:0:14499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.117@tcp lock: ffffa06a41687000/0x99260d7389c0730c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c07313 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043145.859081:0:14499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.117@tcp lock: ffffa06a41687000/0x99260d7389c0730c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x99260d7389c07313 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043145.859132:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f835c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff892c07-94a8-4144-ae30-5a70a83d490b:14499:1875947267664512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789043145.859156:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043145.859182:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a58531600 going to sleep for 11 seconds 00000100:00100000:3.0:1789043145.859272:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267664512 00000100:00100000:3.0:1789043145.859277:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267664512 00000100:00100000:3.0:1789043145.859294:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789043145.859300:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a76599850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+19:14499:x1875947267664512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789043145.859563:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a76599850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+19:14499:x1875947267664512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 262us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043145.859570:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789043145.859600:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f835c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff892c07-94a8-4144-ae30-5a70a83d490b:14499:1875947267664512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789043145.859627:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff892c07-94a8-4144-ae30-5a70a83d490b:14499:1875947267664640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789043145.859662:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043145.859682:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a50a62780 going to sleep for 11 seconds 00000100:00100000:3.0:1789043145.859693:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267664640 00000100:00100000:3.0:1789043145.859695:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267664640 00000100:00100000:3.0:1789043145.859711:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789043145.859716:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a76598050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+19:14499:x1875947267664640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789043145.860055:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a76598050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+19:14499:x1875947267664640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 337us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043145.860062:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789043145.860100:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff892c07-94a8-4144-ae30-5a70a83d490b:14499:1875947267664640:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789043145.861020:0:16681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789043145.861313:0:14499:0:(obd_config.c:2243:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789043145.861347:0:14499:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789043145.861357:0:14499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.117@tcp lock: ffffa06a41687000/0x99260d7389c0730c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c07313 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043145.861367:0:14499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.117@tcp lock: ffffa06a41687000/0x99260d7389c0730c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99260d7389c07313 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043145.971868:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a767dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267664768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789043145.971941:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043145.972026:0:15189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267664768 00000100:00100000:3.0:1789043145.972034:0:15189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267664768 00000100:00100000:3.0:1789043145.972634:0:15189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789043145.972647:0:15189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267664768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789043145.972681:0:15189:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789043145.972733:0:15189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875947267664768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043145.972740:0:15189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1789043145.972764:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789043145.972800:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a767dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875947267664768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789043145.973692:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875947267665024:0@lo:400:kworker.0 00000100:00100000:0.0:1789043145.973735:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043145.973767:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789043145.973773:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267664896:0@lo:400:kworker.0 00000100:00100000:0.0:1789043145.973798:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043145.973824:0:15492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267665024 00000100:00100000:0.0:1789043145.973830:0:15492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267665024 00000100:00100000:0.0:1789043145.973952:0:15492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789043145.973961:0:15492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875947267665024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789043145.974003:0:15492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875947267665024:12345-0@lo:400:kworker.0 Request processed in 44us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043145.974196:0:15492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789043145.974220:0:16375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267664896 00000100:00100000:0.0:1789043145.974223:0:16375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267664896 00000100:00100000:0.0:1789043145.974255:0:16375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789043145.974262:0:16375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267664896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789043145.974293:0:16375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267664896:12345-0@lo:400:kworker.0 Request processed in 32us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043145.974299:0:16375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789043145.974322:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789043145.974345:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267664896:0@lo:400:kworker.0 00000100:00100000:0.0:1789043145.974371:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875947267665024:0@lo:400:kworker.0 00000100:00100000:0.0:1789043145.974396:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875947267665280:0@lo:400:kworker.0 00000100:00100000:0.0:1789043145.974419:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043145.974439:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789043145.974446:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a46ff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875947267665152:0@lo:400:kworker.0 00000100:00100000:0.0:1789043145.974465:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043145.974649:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267665280 00000100:00100000:0.0:1789043145.974654:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267665280 00000100:00100000:0.0:1789043145.974680:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267665152 00000100:00100000:0.0:1789043145.974683:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267665152 00000100:00100000:0.0:1789043145.974701:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789043145.974707:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875947267665280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789043145.974741:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875947267665280:12345-0@lo:400:kworker.0 Request processed in 33us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043145.974747:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789043145.974759:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789043145.974765:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875947267665152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789043145.974791:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875947267665152:12345-0@lo:400:kworker.0 Request processed in 27us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043145.974797:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1789043145.974818:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789043145.975832:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875947267665152:0@lo:400:kworker.0 00000100:00100000:0.0:1789043145.976205:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a46ff0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875947267665280:0@lo:400:kworker.0 00000100:00100000:1.0:1789043146.255053:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043146.255143:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242503296 00000100:00100000:2.0:1789043146.255155:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242503296 00000100:00100000:2.0:1789043146.255217:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 114 00000100:00100000:2.0:1789043146.255228:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a76599450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5996c558-d720-4f58-965c-3a1f4ca9bdac+11:13779:x1875947242503296:12345-192.168.203.17@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789043146.255247:0:14495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043146.255267:0:14495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a58604000/0x99260d7389c0731a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676d7c expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043146.255298:0:14495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a58604000/0x99260d7389c0731a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676d7c expref: 12 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043146.255311:0:14495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a58604000/0x99260d7389c0731a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676d7c expref: 12 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043146.255320:0:14495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a58604000, rc 0) 00000100:00100000:2.0:1789043146.255375:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a76599450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5996c558-d720-4f58-965c-3a1f4ca9bdac+12:13779:x1875947242503296:12345-192.168.203.17@tcp:101:ll_cfg_requeue.0 Request processed in 149us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043146.255383:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 114 00000100:00100000:0.0:1789043146.269379:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043146.274587:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242503424 00000100:00100000:2.0:1789043146.274602:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242503424 00000100:00100000:2.0:1789043146.274664:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 115 00000100:00100000:2.0:1789043146.274675:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a76599c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5996c558-d720-4f58-965c-3a1f4ca9bdac+12:13779:x1875947242503424:12345-192.168.203.17@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789043146.275111:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a76599c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5996c558-d720-4f58-965c-3a1f4ca9bdac+12:13779:x1875947242503424:12345-192.168.203.17@tcp:501:ll_cfg_requeue.0 Request processed in 437us (5739us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043146.275128:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 115 00000100:00100000:2.0:1789043146.285122:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043146.285198:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242503552 00000100:00100000:0.0:1789043146.285218:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242503552 00000100:00100000:0.0:1789043146.285274:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 116 00000100:00100000:0.0:1789043146.285285:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7659a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5996c558-d720-4f58-965c-3a1f4ca9bdac+12:13779:x1875947242503552:12345-192.168.203.17@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789043146.285503:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7659a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5996c558-d720-4f58-965c-3a1f4ca9bdac+12:13779:x1875947242503552:12345-192.168.203.17@tcp:503:ll_cfg_requeue.0 Request processed in 218us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043146.285574:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 116 00000100:00100000:2.0:1789043146.293377:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043146.293451:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242503680 00000100:00100000:3.0:1789043146.293462:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242503680 00000100:00100000:3.0:1789043146.293540:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 117 00000100:00100000:3.0:1789043146.293551:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a76598450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5996c558-d720-4f58-965c-3a1f4ca9bdac+12:13779:x1875947242503680:12345-192.168.203.17@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789043146.293567:0:14495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789043146.293586:0:14495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa06a6fc28e00/0x99260d7389c07321 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676d83 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043146.293629:0:14495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa06a6fc28e00/0x99260d7389c07321 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676d83 expref: 13 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043146.293640:0:14495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa06a6fc28e00/0x99260d7389c07321 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676d83 expref: 13 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043146.293652:0:14495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc28e00, rc 0) 00000100:00100000:3.0:1789043146.293929:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a76598450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5996c558-d720-4f58-965c-3a1f4ca9bdac+13:13779:x1875947242503680:12345-192.168.203.17@tcp:101:ll_cfg_requeue.0 Request processed in 379us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043146.293936:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 117 00000100:00100000:1.0:1789043146.306999:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043146.307871:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242503808 00000100:00100000:2.0:1789043146.307882:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242503808 00000100:00100000:2.0:1789043146.307941:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 118 00000100:00100000:2.0:1789043146.307952:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7659bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5996c558-d720-4f58-965c-3a1f4ca9bdac+13:13779:x1875947242503808:12345-192.168.203.17@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789043146.308251:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7659bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5996c558-d720-4f58-965c-3a1f4ca9bdac+13:13779:x1875947242503808:12345-192.168.203.17@tcp:501:ll_cfg_requeue.0 Request processed in 300us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043146.308260:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 118 00000100:00100000:2.0:1789043146.313696:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043146.313903:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242503936 00000100:00100000:0.0:1789043146.313912:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242503936 00000100:00100000:0.0:1789043146.314001:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 119 00000100:00100000:0.0:1789043146.314021:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5244b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5996c558-d720-4f58-965c-3a1f4ca9bdac+13:13779:x1875947242503936:12345-192.168.203.17@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789043146.314236:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5244b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5996c558-d720-4f58-965c-3a1f4ca9bdac+13:13779:x1875947242503936:12345-192.168.203.17@tcp:503:ll_cfg_requeue.0 Request processed in 217us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043146.314245:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 119 00010000:00010000:3.0:1789043146.359067:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789043147.381084:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789043147.719971:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043147.720089:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242504064 00000100:00100000:0.0:1789043147.720099:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242504064 00000100:00080000:2.0:1789043147.720247:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789043147.720302:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 15 00000100:00100000:0.0:1789043147.720314:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75edea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58509587-cde8-42ed-8b49-4691b2633b0c+6:14435:x1875947242504064:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789043147.720332:0:14503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789043147.720354:0:14503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac000/0x99260d7389c07328 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676d8a expref: -99 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043147.720413:0:14503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ade00/0x99260d7389c0732f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043147.720428:0:14503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ade00/0x99260d7389c0732f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043147.720483:0:14503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ade00/0x99260d7389c0732f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043147.720500:0:14503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac600/0x99260d7389c07336 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043147.720508:0:14503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac600/0x99260d7389c07336 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043147.720552:0:14503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac600/0x99260d7389c07336 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043147.720843:0:14503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac400/0x99260d7389c0733d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043147.720853:0:14503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac400/0x99260d7389c0733d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043147.720862:0:14503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac400/0x99260d7389c0733d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789043147.720884:0:14503:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789043147.720887:0:14503:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789043147.720919:0:14503:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac400/0x99260d7389c0733d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043147.720930:0:14503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ade00/0x99260d7389c0732f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043147.720937:0:14503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ade00/0x99260d7389c0732f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043147.720954:0:14503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ade00/0x99260d7389c0732f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043147.720961:0:14503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa069418ade00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789043147.720965:0:14503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ade00/0x99260d7389c0732f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043147.720973:0:14503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ade00/0x99260d7389c0732f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043147.720984:0:14503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:0.0:1789043147.720987:0:14503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789043147.720992:0:14503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ade00/0x99260d7389c0732f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043147.721009:0:14503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ade00/0x99260d7389c0732f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043147.721023:0:14503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac600/0x99260d7389c07336 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043147.721033:0:14503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac600/0x99260d7389c07336 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043147.721039:0:14503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac600/0x99260d7389c07336 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043147.721044:0:14503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa069418ac600 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789043147.721047:0:14503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac600/0x99260d7389c07336 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043147.721062:0:14503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac600/0x99260d7389c07336 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043147.721071:0:14503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffffa06a42b36900) 00010000:00010000:0.0:1789043147.721073:0:14503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789043147.721076:0:14503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac600/0x99260d7389c07336 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043147.721081:0:14503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac600/0x99260d7389c07336 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043147.721115:0:14503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac000/0x99260d7389c07328 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676d8a expref: 8 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043147.721128:0:14503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac400/0x99260d7389c0733d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676d8a expref: 7 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043147.721136:0:14503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa06a42b36700) 00010000:00010000:0.0:1789043147.721138:0:14503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789043147.721140:0:14503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa069418ac400, rc 0) 00000100:00100000:0.0:1789043147.721206:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75edea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58509587-cde8-42ed-8b49-4691b2633b0c+7:14435:x1875947242504064:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 895us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043147.721214:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 15 00000100:00100000:0.0:1789043147.727071:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043147.727186:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242504320 00000100:00100000:2.0:1789043147.727199:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242504320 00000100:00100000:2.0:1789043147.727270:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 16 00000100:00100000:2.0:1789043147.727283:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58509587-cde8-42ed-8b49-4691b2633b0c+7:14435:x1875947242504320:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789043147.727311:0:14502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043147.727337:0:14502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604200/0x99260d7389c07344 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676d91 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.727820:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605200/0x99260d7389c0734b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.727840:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605200/0x99260d7389c0734b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.727872:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605200/0x99260d7389c0734b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.730117:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605c00/0x99260d7389c07352 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.730141:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605c00/0x99260d7389c07352 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.730156:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605c00/0x99260d7389c07352 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.731190:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604600/0x99260d7389c07359 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.731216:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604600/0x99260d7389c07359 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.731227:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604600/0x99260d7389c07359 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789043147.731240:0:14502:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1789043147.732120:0:14502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605200/0x99260d7389c0734b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.732131:0:14502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605200/0x99260d7389c0734b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.732138:0:14502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605200/0x99260d7389c0734b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.732145:0:14502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a58605200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043147.732159:0:14502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605200/0x99260d7389c0734b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.732167:0:14502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605200/0x99260d7389c0734b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.732180:0:14502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa06a42b36700) 00010000:00010000:2.0:1789043147.732182:0:14502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043147.732187:0:14502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605200/0x99260d7389c0734b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.732194:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605200/0x99260d7389c0734b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.732208:0:14502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605c00/0x99260d7389c07352 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.732215:0:14502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605c00/0x99260d7389c07352 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.732221:0:14502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605c00/0x99260d7389c07352 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.732225:0:14502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a58605c00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043147.732228:0:14502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605c00/0x99260d7389c07352 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.732234:0:14502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605c00/0x99260d7389c07352 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.732242:0:14502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffffa06a457d6100) 00010000:00010000:2.0:1789043147.732244:0:14502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043147.732254:0:14502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605c00/0x99260d7389c07352 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.732260:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605c00/0x99260d7389c07352 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.733362:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604200/0x99260d7389c07344 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676d91 expref: 10 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.733384:0:14502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604600/0x99260d7389c07359 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676d91 expref: 9 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.733391:0:14502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa06a457d6800) 00010000:00010000:2.0:1789043147.733394:0:14502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043147.733397:0:14502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a58604600, rc 0) 00000100:00100000:2.0:1789043147.733480:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58509587-cde8-42ed-8b49-4691b2633b0c+9:14435:x1875947242504320:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 6199us (6423us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789043147.733488:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 16 00000100:00100000:2.0:1789043147.746038:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043147.746200:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242504448 00000100:00100000:1.0:1789043147.746211:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242504448 00000100:00100000:1.0:1789043147.746277:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 17 00000100:00100000:1.0:1789043147.746288:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75edd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58509587-cde8-42ed-8b49-4691b2633b0c+9:14435:x1875947242504448:12345-192.168.203.17@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789043147.746407:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75edd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58509587-cde8-42ed-8b49-4691b2633b0c+9:14435:x1875947242504448:12345-192.168.203.17@tcp:59:lhsmtool_posix.0 Request processed in 121us (3904us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043147.746414:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 17 00000100:00100000:0.0:1789043147.791584:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043147.791753:0:15492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242504576 00000100:00100000:2.0:1789043147.791768:0:15492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242504576 00000100:00100000:2.0:1789043147.791849:0:15492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 18 00000100:00100000:2.0:1789043147.791860:0:15492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58509587-cde8-42ed-8b49-4691b2633b0c+9:14441:x1875947242504576:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:2.0:1789043147.791878:0:15492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043147.791899:0:15492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605c00/0x99260d7389c07367 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676d98 expref: -99 pid: 15492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.791964:0:15492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605200/0x99260d7389c0736e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.792006:0:15492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605200/0x99260d7389c0736e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.792018:0:15492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605200/0x99260d7389c0736e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.792036:0:15492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604200/0x99260d7389c07375 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.792043:0:15492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604200/0x99260d7389c07375 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.792049:0:15492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604200/0x99260d7389c07375 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.792243:0:15492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605200/0x99260d7389c0736e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.792251:0:15492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605200/0x99260d7389c0736e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.792257:0:15492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605200/0x99260d7389c0736e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.792263:0:15492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a58605200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043147.792268:0:15492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605200/0x99260d7389c0736e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.792275:0:15492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605200/0x99260d7389c0736e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.792286:0:15492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:2.0:1789043147.792295:0:15492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043147.792301:0:15492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605200/0x99260d7389c0736e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.792307:0:15492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605200/0x99260d7389c0736e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.792322:0:15492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604200/0x99260d7389c07375 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.792328:0:15492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604200/0x99260d7389c07375 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.792334:0:15492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604200/0x99260d7389c07375 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.792339:0:15492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a58604200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043147.792341:0:15492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604200/0x99260d7389c07375 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.792347:0:15492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604200/0x99260d7389c07375 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.792355:0:15492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa06a457d6100) 00010000:00010000:2.0:1789043147.792357:0:15492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043147.792360:0:15492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604200/0x99260d7389c07375 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.792366:0:15492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604200/0x99260d7389c07375 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.792401:0:15492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605c00/0x99260d7389c07367 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676d98 expref: 10 pid: 15492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.792418:0:15492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:2.0:1789043147.792420:0:15492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043147.792425:0:15492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605c00/0x99260d7389c07367 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676d98 expref: 10 pid: 15492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.792434:0:15492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a58605c00, rc 0) 00000100:00100000:2.0:1789043147.793747:0:15492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58509587-cde8-42ed-8b49-4691b2633b0c+9:14441:x1875947242504576:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 1879us (2168us total) trans 0 rc 301/301 00000100:00100000:2.0:1789043147.793758:0:15492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 18 00000100:00100000:2.0:1789043147.801201:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043147.801313:0:14510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242504704 00000100:00100000:3.0:1789043147.801324:0:14510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242504704 00000100:00100000:3.0:1789043147.801416:0:14510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 0 00000100:00100000:3.0:1789043147.801427:0:14510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75edca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:58509587-cde8-42ed-8b49-4691b2633b0c+9:14441:x1875947242504704:12345-192.168.203.17@tcp:700:lfs.0 00000100:00100000:3.0:1789043147.801560:0:14510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75edca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:58509587-cde8-42ed-8b49-4691b2633b0c+9:14441:x1875947242504704:12345-192.168.203.17@tcp:700:lfs.0 Request processed in 135us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043147.801567:0:14510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 0 00000100:00100000:3.0:1789043147.807394:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043147.807495:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242504960 00000100:00100000:1.0:1789043147.807511:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242504960 00000100:00100000:1.0:1789043147.807630:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 19 00000100:00100000:1.0:1789043147.807640:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58509587-cde8-42ed-8b49-4691b2633b0c+9:14441:x1875947242504960:12345-192.168.203.17@tcp:36:lfs.0 00010000:00010000:1.0:1789043147.807696:0:14501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789043147.807724:0:14501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c072aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676d13 expref: 9 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043147.807747:0:14501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:1.0:1789043147.807753:0:14501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789043147.807984:0:14501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c0737c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043147.808021:0:14501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605a00/0x99260d7389c072e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676d75 expref: 5 pid: 15492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043147.808029:0:14501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c0737c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043147.808064:0:14501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605a00/0x99260d7389c072e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676d75 expref: 5 pid: 15492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043147.808077:0:14501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605a00/0x99260d7389c072e2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676d75 expref: 5 pid: 15492 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043147.808092:0:14501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f835880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14501:1875947267665408:192.168.203.17@tcp:104: 00000100:00100000:1.0:1789043147.808199:0:14501:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a467dc540 going to sleep for 11 seconds 00000100:00100000:0.0:1789043147.816374:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043147.816585:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242505088 00000100:00100000:3.0:1789043147.816603:0:14486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242505088 00000100:00100000:1.0:1789043147.816620:0:14501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f835880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14501:1875947267665408:192.168.203.17@tcp:104: 00010000:00010000:1.0:1789043147.816649:0:14501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c0737c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043147.816678:0:14486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605a00/0x99260d7389c072e2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676d75 expref: 6 pid: 15492 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043147.816733:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 9 00000100:00100000:3.0:1789043147.816747:0:14486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+6:2352:x1875947242505088:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789043147.816780:0:14486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789043147.816789:0:14486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605a00/0x99260d7389c072e2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676d75 expref: 6 pid: 15492 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043147.816804:0:14486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605a00/0x99260d7389c072e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676d75 expref: 6 pid: 15492 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043147.816832:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605a00/0x99260d7389c072e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676d75 expref: 6 pid: 15492 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043147.816852:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:3.0:1789043147.816859:0:14486:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c0737c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043147.816870:0:14486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c0737c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043147.816879:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c0737c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043147.816911:0:14486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789043147.816944:0:14501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c0737c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043147.816955:0:14501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c0737c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043147.816982:0:14501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c07383 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043147.817004:0:14501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c07383 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043147.817030:0:14501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c07383 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043147.817056:0:14486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+5:2352:x1875947242505088:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 312us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043147.817066:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 9 00000100:00080000:2.0:1789043147.817167:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1789043147.821263:0:14501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789043147.821285:0:14501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c0737c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043147.821295:0:14501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c0737c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043147.821303:0:14501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c0737c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043147.821309:0:14501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687e00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043147.821314:0:14501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c0737c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043147.821335:0:14501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c0737c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043147.821354:0:14501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:1.0:1789043147.821357:0:14501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043147.821362:0:14501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c0737c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043147.821369:0:14501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c0737c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789043147.821389:0:14501:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008368bbc5 reply state 00000000016cb9b2 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c07383 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043147.821411:0:14501:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789043147.821548:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58509587-cde8-42ed-8b49-4691b2633b0c+10:14441:x1875947242504960:12345-192.168.203.17@tcp:36:lfs.0 Request processed in 13904us (14164us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789043147.821556:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 19 00010000:00010000:1.0:1789043147.831963:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c07383 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043147.832002:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c07383 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043147.832011:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c07383 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043147.832018:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686800 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043147.832024:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c07383 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043147.832033:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c07383 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043147.832052:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa06a44e19300) 00010000:00010000:1.0:1789043147.832056:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043147.832062:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c07383 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043147.832069:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c07383 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043147.943368:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043147.943488:0:15492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242505216 00000100:00100000:2.0:1789043147.943501:0:15492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242505216 00000100:00100000:2.0:1789043147.943594:0:15492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 20 00000100:00100000:2.0:1789043147.943607:0:15492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58509587-cde8-42ed-8b49-4691b2633b0c+9:14449:x1875947242505216:12345-192.168.203.17@tcp:101:lctl.0 00010000:00010000:2.0:1789043147.943636:0:15492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043147.943662:0:15492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605200/0x99260d7389c0738a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676d9f expref: -99 pid: 15492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.943742:0:15492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604c00/0x99260d7389c07391 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.943757:0:15492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604c00/0x99260d7389c07391 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.943771:0:15492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604c00/0x99260d7389c07391 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789043147.943832:0:15492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789043147.943836:0:15492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789043147.943879:0:15492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604c00/0x99260d7389c07391 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.943908:0:15492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605200/0x99260d7389c0738a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676d9f expref: 11 pid: 15492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.943928:0:15492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604c00/0x99260d7389c07391 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676d9f expref: 10 pid: 15492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.943937:0:15492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a457d6100) 00010000:00010000:2.0:1789043147.943940:0:15492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789043147.943945:0:15492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a58604c00, rc 0) 00000100:00100000:2.0:1789043147.944038:0:15492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58509587-cde8-42ed-8b49-4691b2633b0c+10:14449:x1875947242505216:12345-192.168.203.17@tcp:101:lctl.0 Request processed in 433us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043147.944046:0:15492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 20 00000100:00100000:0.0:1789043147.975734:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043147.975932:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242505344 00000100:00100000:3.0:1789043147.975950:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242505344 00000100:00100000:3.0:1789043147.976020:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 21 00000100:00100000:3.0:1789043147.976031:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+5:14450:x1875947242505344:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:3.0:1789043147.976059:0:14503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789043147.976079:0:14503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28000/0x99260d7389c07398 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676da6 expref: -99 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043147.976138:0:14503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29a00/0x99260d7389c0739f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043147.976152:0:14503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29a00/0x99260d7389c0739f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043147.976164:0:14503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29a00/0x99260d7389c0739f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789043147.976197:0:14503:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789043147.976200:0:14503:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789043147.976219:0:14503:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29a00/0x99260d7389c0739f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043147.976241:0:14503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28000/0x99260d7389c07398 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676da6 expref: 7 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043147.976260:0:14503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc29a00/0x99260d7389c0739f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676da6 expref: 6 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043147.976268:0:14503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a457d6100) 00010000:00010000:3.0:1789043147.976270:0:14503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789043147.976274:0:14503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a6fc29a00, rc 0) 00000100:00100000:3.0:1789043147.976654:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+6:14450:x1875947242505344:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 623us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043147.976662:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 21 00000100:00100000:3.0:1789043147.982641:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043147.982814:0:15492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242505472 00000100:00100000:2.0:1789043147.982831:0:15492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242505472 00000100:00100000:2.0:1789043147.982929:0:15492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 22 00000100:00100000:2.0:1789043147.982943:0:15492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+6:14450:x1875947242505472:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:2.0:1789043147.982979:0:15492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043147.983013:0:15492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605200/0x99260d7389c073a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676dad expref: -99 pid: 15492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.983096:0:15492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605000/0x99260d7389c073ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.983130:0:15492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605000/0x99260d7389c073ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.983143:0:15492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605000/0x99260d7389c073ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.983172:0:15492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604800/0x99260d7389c073b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.983180:0:15492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604800/0x99260d7389c073b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.983187:0:15492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604800/0x99260d7389c073b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.989977:0:15492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605e00/0x99260d7389c073bb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.990009:0:15492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605e00/0x99260d7389c073bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.990025:0:15492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605e00/0x99260d7389c073bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789043147.990070:0:15492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789043147.990074:0:15492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789043147.990098:0:15492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605e00/0x99260d7389c073bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.990111:0:15492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605000/0x99260d7389c073ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.990141:0:15492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605000/0x99260d7389c073ad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.990148:0:15492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605000/0x99260d7389c073ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.990154:0:15492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a58605000 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043147.990159:0:15492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605000/0x99260d7389c073ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.990845:0:15492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605000/0x99260d7389c073ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.990859:0:15492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a457d6100) 00010000:00010000:2.0:1789043147.990862:0:15492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043147.990868:0:15492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605000/0x99260d7389c073ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.990874:0:15492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605000/0x99260d7389c073ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.990893:0:15492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604800/0x99260d7389c073b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.990900:0:15492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604800/0x99260d7389c073b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.990906:0:15492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604800/0x99260d7389c073b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.990911:0:15492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a58604800 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043147.990924:0:15492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604800/0x99260d7389c073b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.990931:0:15492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604800/0x99260d7389c073b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.990939:0:15492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa06a457d6f00) 00010000:00010000:2.0:1789043147.990941:0:15492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043147.990944:0:15492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604800/0x99260d7389c073b4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.990949:0:15492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604800/0x99260d7389c073b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.991006:0:15492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605200/0x99260d7389c073a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dad expref: 8 pid: 15492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.991022:0:15492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605e00/0x99260d7389c073bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dad expref: 7 pid: 15492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043147.991029:0:15492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa06a457d6b00) 00010000:00010000:2.0:1789043147.991031:0:15492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789043147.991035:0:15492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a58605e00, rc 0) 00000100:00100000:2.0:1789043147.991192:0:15492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+7:14450:x1875947242505472:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 8250us (8559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043147.991200:0:15492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 22 00000100:00100000:0.0:1789043147.999198:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043148.002851:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242505728 00000100:00100000:1.0:1789043148.002867:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242505728 00000100:00100000:1.0:1789043148.003409:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 23 00000100:00100000:1.0:1789043148.003419:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+7:14450:x1875947242505728:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:1.0:1789043148.004014:0:14501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043148.004038:0:14501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c073c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676db4 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789043148.004126:0:14501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789043148.005332:0:14501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c073c2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676db4 expref: 9 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043148.005350:0:14501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a457d6100) 00010000:00010000:1.0:1789043148.005353:0:14501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789043148.005358:0:14501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c073c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676db4 expref: 9 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043148.005373:0:14501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41686800, rc 0) 00000100:00100000:1.0:1789043148.005452:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+8:14450:x1875947242505728:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 2034us (6263us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1789043148.005461:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 23 00000100:00100000:0.0:1789043148.011660:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043148.011775:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242505984 00000100:00100000:2.0:1789043148.011785:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242505984 00000100:00100000:2.0:1789043148.011851:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 24 00000100:00100000:2.0:1789043148.011862:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+8:14450:x1875947242505984:12345-192.168.203.17@tcp:36:lfs.0 00010000:00010000:2.0:1789043148.011938:0:14502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789043148.011964:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605e00/0x99260d7389c073bb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dad expref: 8 pid: 15492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043148.011984:0:14502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa06a457d6b00) 00010000:00010000:2.0:1789043148.012009:0:14502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789043148.012033:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605200/0x99260d7389c073d0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043148.012053:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605200/0x99260d7389c073d0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043148.012068:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605200/0x99260d7389c073d0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789043148.012288:0:14502:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c33952b reply state 00000000d384eada transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605200/0x99260d7389c073d0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043148.012298:0:14502:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789043148.012306:0:14502:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789043148.012393:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+9:14450:x1875947242505984:12345-192.168.203.17@tcp:36:lfs.0 Request processed in 532us (741us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789043148.012400:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 24 00010000:00010000:2.0:1789043148.030613:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605200/0x99260d7389c073d0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043148.030631:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605200/0x99260d7389c073d0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043148.030639:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605200/0x99260d7389c073d0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043148.030661:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a58605200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043148.030666:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605200/0x99260d7389c073d0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043148.030674:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605200/0x99260d7389c073d0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043148.030690:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa06a457d6f00) 00010000:00010000:2.0:1789043148.030692:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1789043148.030697:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605200/0x99260d7389c073d0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043148.030703:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605200/0x99260d7389c073d0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043148.031428:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043148.031751:0:14504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242506240 00000100:00100000:3.0:1789043148.031762:0:14504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242506240 00000100:00100000:3.0:1789043148.031820:0:14504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 2 00000100:00100000:3.0:1789043148.031829:0:14504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+8:14450:x1875947242506240:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:3.0:1789043148.032421:0:14504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+9:14450:x1875947242506240:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 590us (996us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789043148.032429:0:14504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 2 00000100:00100000:3.0:1789043148.037361:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043148.038199:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242506496 00000100:00100000:0.0:1789043148.038210:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242506496 00000100:00100000:0.0:1789043148.038288:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 25 00000100:00100000:0.0:1789043148.038299:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+9:14450:x1875947242506496:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:0.0:1789043148.038326:0:14503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789043148.038346:0:14503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac800/0x99260d7389c073d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676dbb expref: -99 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.038416:0:14503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c073de lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.038429:0:14503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c073de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.038441:0:14503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c073de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.038454:0:14503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad000/0x99260d7389c073e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.038476:0:14503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad000/0x99260d7389c073e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.038482:0:14503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad000/0x99260d7389c073e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789043148.038630:0:14503:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789043148.038721:0:14503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c073de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.038748:0:14503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c073de lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.038756:0:14503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c073de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.038762:0:14503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa069418aca00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789043148.038766:0:14503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c073de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.038774:0:14503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c073de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.038785:0:14503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a457d6100) 00010000:00010000:0.0:1789043148.038788:0:14503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789043148.038793:0:14503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c073de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.038799:0:14503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c073de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.038812:0:14503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad000/0x99260d7389c073e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.038818:0:14503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad000/0x99260d7389c073e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.038823:0:14503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad000/0x99260d7389c073e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.038828:0:14503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa069418ad000 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789043148.038837:0:14503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad000/0x99260d7389c073e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.038844:0:14503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad000/0x99260d7389c073e5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.038853:0:14503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa06a42b36900) 00010000:00010000:0.0:1789043148.038855:0:14503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789043148.038858:0:14503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad000/0x99260d7389c073e5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.038864:0:14503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad000/0x99260d7389c073e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.038913:0:14503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac800/0x99260d7389c073d7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dbb expref: 11 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.038922:0:14503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a457d6100) 00010000:00010000:0.0:1789043148.038924:0:14503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789043148.038928:0:14503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac800/0x99260d7389c073d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dbb expref: 11 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.038937:0:14503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa069418ac800, rc 0) 00000100:00100000:0.0:1789043148.039011:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+10:14450:x1875947242506496:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 713us (1659us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1789043148.039018:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 25 00000100:00100000:0.0:1789043148.045221:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043148.045656:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242506624 00000100:00100000:2.0:1789043148.045667:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242506624 00000100:00100000:2.0:1789043148.045726:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 26 00000100:00100000:2.0:1789043148.045745:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+10:14450:x1875947242506624:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:2.0:1789043148.045768:0:14502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043148.045789:0:14502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605e00/0x99260d7389c073f3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676dc2 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043148.045873:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604800/0x99260d7389c073fa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043148.045887:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604800/0x99260d7389c073fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043148.045901:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604800/0x99260d7389c073fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789043148.045950:0:14502:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789043148.045954:0:14502:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789043148.045973:0:14502:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604800/0x99260d7389c073fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043148.046011:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605e00/0x99260d7389c073f3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dc2 expref: 12 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043148.046029:0:14502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604800/0x99260d7389c073fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dc2 expref: 11 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043148.046038:0:14502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa06a457d6f00) 00010000:00010000:2.0:1789043148.046040:0:14502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789043148.046044:0:14502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a58604800, rc 0) 00000100:00100000:2.0:1789043148.046107:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+11:14450:x1875947242506624:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 372us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043148.046114:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 26 00000100:00100000:2.0:1789043148.049295:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043148.049385:0:14505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242506752 00000100:00100000:1.0:1789043148.049394:0:14505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242506752 00000100:00100000:1.0:1789043148.049448:0:14505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 3 00000100:00100000:1.0:1789043148.049457:0:14505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75eded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+11:14450:x1875947242506752:12345-192.168.203.17@tcp:37:lfs.0 00000100:00100000:1.0:1789043148.055102:0:14505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75eded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+11:14450:x1875947242506752:12345-192.168.203.17@tcp:37:lfs.0 Request processed in 5635us (5805us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043148.055115:0:14505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 3 00000100:00100000:0.0:1789043148.061288:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043148.061430:0:14504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242507008 00000100:00100000:3.0:1789043148.061439:0:14504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242507008 00000100:00100000:3.0:1789043148.061511:0:14504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 4 00000100:00100000:3.0:1789043148.061540:0:14504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa069412f1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+11:14450:x1875947242507008:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:3.0:1789043148.061782:0:14504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa069412f1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+12:14450:x1875947242507008:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 242us (501us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789043148.061790:0:14504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 4 00000100:00100000:2.0:1789043148.170179:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043148.170566:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242507136 00000100:00100000:0.0:1789043148.170594:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242507136 00000100:00100000:0.0:1789043148.170646:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 27 00000100:00100000:0.0:1789043148.170657:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75edc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58509587-cde8-42ed-8b49-4691b2633b0c+10:14456:x1875947242507136:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:0.0:1789043148.170677:0:14503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789043148.170698:0:14503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad000/0x99260d7389c07401 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676dc9 expref: -99 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.170759:0:14503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c07408 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.170773:0:14503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c07408 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.170784:0:14503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c07408 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.170797:0:14503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad200/0x99260d7389c0740f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.170804:0:14503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad200/0x99260d7389c0740f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.170815:0:14503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad200/0x99260d7389c0740f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.170909:0:14503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ade00/0x99260d7389c07416 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.170918:0:14503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ade00/0x99260d7389c07416 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.170924:0:14503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ade00/0x99260d7389c07416 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789043148.170959:0:14503:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789043148.170962:0:14503:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789043148.171009:0:14503:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ade00/0x99260d7389c07416 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.171021:0:14503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c07408 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.171028:0:14503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c07408 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.171034:0:14503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c07408 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.171040:0:14503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa069418aca00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789043148.171044:0:14503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c07408 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.171052:0:14503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c07408 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.171063:0:14503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a457d6100) 00010000:00010000:0.0:1789043148.171066:0:14503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789043148.171071:0:14503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c07408 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.171077:0:14503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c07408 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.171091:0:14503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad200/0x99260d7389c0740f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.171108:0:14503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad200/0x99260d7389c0740f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.171113:0:14503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad200/0x99260d7389c0740f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.171118:0:14503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa069418ad200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789043148.171121:0:14503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad200/0x99260d7389c0740f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.171128:0:14503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad200/0x99260d7389c0740f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.171137:0:14503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa06a42b36900) 00010000:00010000:0.0:1789043148.171139:0:14503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789043148.171142:0:14503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad200/0x99260d7389c0740f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.171148:0:14503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad200/0x99260d7389c0740f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.171184:0:14503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad000/0x99260d7389c07401 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dc9 expref: 12 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.171198:0:14503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ade00/0x99260d7389c07416 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dc9 expref: 11 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.171205:0:14503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa06a457d6f00) 00010000:00010000:0.0:1789043148.171207:0:14503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789043148.171217:0:14503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa069418ade00, rc 0) 00000100:00100000:0.0:1789043148.171657:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75edc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58509587-cde8-42ed-8b49-4691b2633b0c+11:14456:x1875947242507136:12345-192.168.203.17@tcp:101:bash.0 Request processed in 1000us (1486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043148.171666:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 27 00000100:00100000:2.0:1789043148.178499:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043148.178731:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242507392 00000100:00100000:0.0:1789043148.178741:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242507392 00000100:00100000:0.0:1789043148.178801:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 28 00000100:00100000:0.0:1789043148.178812:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75edf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58509587-cde8-42ed-8b49-4691b2633b0c+11:14456:x1875947242507392:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:0.0:1789043148.178832:0:14502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789043148.178853:0:14502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad000/0x99260d7389c0741d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676dd0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.178970:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad200/0x99260d7389c07424 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.178985:0:14502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604800/0x99260d7389c073fa lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dc2 expref: 11 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.179003:0:14502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad200/0x99260d7389c07424 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.179038:0:14502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604800/0x99260d7389c073fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dc2 expref: 11 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.179052:0:14502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604800/0x99260d7389c073fa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dc2 expref: 11 pid: 14502 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043148.179067:0:14502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a763caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14502:1875947267665536:192.168.203.17@tcp:104: 00000100:00100000:0.0:1789043148.179250:0:14502:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a464c7000 going to sleep for 11 seconds 00000100:00100000:0.0:1789043148.185078:0:14502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a763caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14502:1875947267665536:192.168.203.17@tcp:104: 00010000:00010000:0.0:1789043148.185109:0:14502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad200/0x99260d7389c07424 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043148.185676:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043148.185755:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242507520 00000100:00100000:3.0:1789043148.185762:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242507520 00010000:00010000:3.0:1789043148.185799:0:14488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604800/0x99260d7389c073fa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dc2 expref: 12 pid: 14502 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043148.185840:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00100000:3.0:1789043148.185851:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75eddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+12:2351:x1875947242507520:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789043148.185865:0:14488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789043148.185872:0:14488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604800/0x99260d7389c073fa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dc2 expref: 12 pid: 14502 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043148.185920:0:14488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604800/0x99260d7389c073fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dc2 expref: 12 pid: 14502 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043148.185944:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604800/0x99260d7389c073fa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dc2 expref: 12 pid: 14502 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043148.185961:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa06a457d6f00) 00010000:00010000:3.0:1789043148.185967:0:14488:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad200/0x99260d7389c07424 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043148.185977:0:14488:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad200/0x99260d7389c07424 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043148.185985:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad200/0x99260d7389c07424 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043148.186028:0:14488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789043148.186084:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75eddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+11:2351:x1875947242507520:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 235us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043148.186092:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 10 00010000:00010000:2.0:1789043148.186256:0:14502:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad200/0x99260d7389c07424 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043148.186265:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad200/0x99260d7389c07424 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043148.186289:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604a00/0x99260d7389c0742b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043148.186306:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604a00/0x99260d7389c0742b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043148.186315:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604a00/0x99260d7389c0742b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043148.187036:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605000/0x99260d7389c07432 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043148.187047:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605000/0x99260d7389c07432 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043148.187055:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605000/0x99260d7389c07432 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789043148.187065:0:14502:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789043148.187089:0:14502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad200/0x99260d7389c07424 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043148.187096:0:14502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad200/0x99260d7389c07424 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043148.187101:0:14502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad200/0x99260d7389c07424 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043148.187106:0:14502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa069418ad200 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043148.187110:0:14502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad200/0x99260d7389c07424 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043148.187117:0:14502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad200/0x99260d7389c07424 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043148.187137:0:14502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa06a457d6f00) 00010000:00010000:2.0:1789043148.187140:0:14502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043148.187144:0:14502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad200/0x99260d7389c07424 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043148.187150:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad200/0x99260d7389c07424 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789043148.187161:0:14502:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc9ac08d reply state 0000000056ace153 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604a00/0x99260d7389c0742b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043148.187168:0:14502:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789043148.187197:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad000/0x99260d7389c0741d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dd0 expref: 14 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043148.187208:0:14502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605000/0x99260d7389c07432 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dd0 expref: 13 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043148.187214:0:14502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa06a457d6d00) 00010000:00010000:2.0:1789043148.187217:0:14502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789043148.187219:0:14502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a58605000, rc 0) 00000100:00100000:2.0:1789043148.187273:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75edf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58509587-cde8-42ed-8b49-4691b2633b0c+14:14456:x1875947242507392:12345-192.168.203.17@tcp:101:bash.0 Request processed in 8463us (8784us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789043148.187280:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 28 00010000:00010000:1.0:1789043148.191431:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604a00/0x99260d7389c0742b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043148.191465:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604a00/0x99260d7389c0742b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043148.191473:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604a00/0x99260d7389c0742b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043148.191479:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a58604a00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043148.191484:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604a00/0x99260d7389c0742b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043148.191491:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604a00/0x99260d7389c0742b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043148.191507:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffffa06a457d6b00) 00010000:00010000:1.0:1789043148.191510:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043148.191703:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604a00/0x99260d7389c0742b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043148.191712:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604a00/0x99260d7389c0742b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043148.210173:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043148.210552:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242507648 00000100:00100000:0.0:1789043148.210563:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242507648 00000100:00100000:0.0:1789043148.210630:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 29 00000100:00100000:0.0:1789043148.210641:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58509587-cde8-42ed-8b49-4691b2633b0c+13:14456:x1875947242507648:12345-192.168.203.17@tcp:101:bash.0 00010000:00010000:0.0:1789043148.210665:0:14501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789043148.210686:0:14501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c07440 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676dd7 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.210753:0:14501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac600/0x99260d7389c07447 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.211130:0:14501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac600/0x99260d7389c07447 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.211145:0:14501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac600/0x99260d7389c07447 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789043148.211185:0:14501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789043148.211189:0:14501:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789043148.211209:0:14501:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac600/0x99260d7389c07447 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.211221:0:14501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac600/0x99260d7389c07447 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.211272:0:14501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c07440 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dd7 expref: 15 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.211291:0:14501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac600/0x99260d7389c07447 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dd7 expref: 14 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.211299:0:14501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa06a457d6d00) 00010000:00010000:0.0:1789043148.211302:0:14501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789043148.211306:0:14501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa069418ac600, rc 0) 00000100:00100000:0.0:1789043148.211634:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58509587-cde8-42ed-8b49-4691b2633b0c+14:14456:x1875947242507648:12345-192.168.203.17@tcp:101:bash.0 Request processed in 993us (1468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043148.211642:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 29 00000100:00100000:3.0:1789043148.219629:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043148.219747:0:14504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242507904 00000100:00100000:0.0:1789043148.219757:0:14504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242507904 00000100:00100000:0.0:1789043148.219815:0:14504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 5 00000100:00100000:0.0:1789043148.219827:0:14504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58509587-cde8-42ed-8b49-4691b2633b0c+14:14456:x1875947242507904:12345-192.168.203.17@tcp:35:bash.0 00000100:00100000:0.0:1789043148.220199:0:14504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58509587-cde8-42ed-8b49-4691b2633b0c+15:14456:x1875947242507904:12345-192.168.203.17@tcp:35:bash.0 Request processed in 372us (584us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1789043148.220207:0:14504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 5 00000100:00100000:2.0:1789043148.308954:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043148.309051:0:15492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242508160 00000100:00100000:0.0:1789043148.309061:0:15492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242508160 00000100:00100000:0.0:1789043148.309131:0:15492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 30 00000100:00100000:0.0:1789043148.309142:0:15492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75edce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58509587-cde8-42ed-8b49-4691b2633b0c+15:14466:x1875947242508160:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:0.0:1789043148.309167:0:15492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789043148.309186:0:15492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c0744e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676dde expref: -99 pid: 15492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789043148.309445:0:15492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789043148.312006:0:15492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c0744e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dde expref: 17 pid: 15492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.312026:0:15492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa06a457d6100) 00010000:00010000:0.0:1789043148.312029:0:15492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789043148.312035:0:15492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c0744e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dde expref: 17 pid: 15492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.312051:0:15492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa069418aca00, rc 0) 00000100:00100000:0.0:1789043148.312145:0:15492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75edce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58509587-cde8-42ed-8b49-4691b2633b0c+16:14466:x1875947242508160:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 3004us (3200us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1789043148.312154:0:15492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 30 00000100:00100000:1.0:1789043148.317401:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043148.317487:0:14504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242508416 00000100:00100000:0.0:1789043148.317497:0:14504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242508416 00000100:00100000:0.0:1789043148.317601:0:14504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 6 00000100:00100000:0.0:1789043148.317611:0:14504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58509587-cde8-42ed-8b49-4691b2633b0c+16:14466:x1875947242508416:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:0.0:1789043148.317926:0:14504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58509587-cde8-42ed-8b49-4691b2633b0c+17:14466:x1875947242508416:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 315us (532us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1789043148.317935:0:14504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 6 00000100:00100000:3.0:1789043148.385199:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043148.386836:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242508672 00000100:00100000:0.0:1789043148.386849:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242508672 00000100:00100000:0.0:1789043148.387169:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 31 00000100:00100000:0.0:1789043148.387180:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58509587-cde8-42ed-8b49-4691b2633b0c+17:14469:x1875947242508672:12345-192.168.203.17@tcp:101:lfs.0 00010000:00010000:0.0:1789043148.387207:0:14503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789043148.387244:0:14503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c0745c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676de5 expref: -99 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.387356:0:14503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac000/0x99260d7389c07463 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.387372:0:14503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac000/0x99260d7389c07463 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.387383:0:14503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac000/0x99260d7389c07463 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789043148.387395:0:14503:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789043148.387548:0:14503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c0745c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676de5 expref: 20 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.387569:0:14503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac000/0x99260d7389c07463 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676de5 expref: 19 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.387577:0:14503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa06a457d6d00) 00010000:00010000:0.0:1789043148.387580:0:14503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789043148.387584:0:14503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa069418ac000, rc 0) 00000100:00100000:0.0:1789043148.387655:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58509587-cde8-42ed-8b49-4691b2633b0c+19:14469:x1875947242508672:12345-192.168.203.17@tcp:101:lfs.0 Request processed in 477us (2465us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1789043148.387663:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 31 00000100:00100000:2.0:1789043148.397202:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043148.397297:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043148.398057:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242508928 00000100:00100000:3.0:1789043148.398068:0:14486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242508928 00000100:00100000:3.0:1789043148.398138:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 0 00000100:00100000:3.0:1789043148.398149:0:14486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58509587-cde8-42ed-8b49-4691b2633b0c+19:2351:x1875947242508928:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789043148.398165:0:14486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789043148.398208:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac000/0x99260d7389c07463 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676de5 expref: 19 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043148.398229:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa06a457d6d00) 00010000:00010000:3.0:1789043148.398234:0:14486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789043148.398309:0:14486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58509587-cde8-42ed-8b49-4691b2633b0c+18:2351:x1875947242508928:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 152us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043148.398317:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 0 00000100:00100000:0.0:1789043148.401665:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242508800 00000100:00100000:0.0:1789043148.401679:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242508800 00010000:00010000:3.0:1789043148.403561:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789043148.404668:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 32 00000100:00100000:1.0:1789043148.404680:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75ede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58509587-cde8-42ed-8b49-4691b2633b0c+18:14469:x1875947242508800:12345-192.168.203.17@tcp:54:lfs.0 00010000:00010000:1.0:1789043148.404812:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c07471 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043148.404831:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c07471 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043148.404861:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c07471 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043148.404963:0:14502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c07471 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043148.404971:0:14502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c07471 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043148.404978:0:14502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c07471 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043148.404984:0:14502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687e00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043148.404988:0:14502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c07471 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043148.405007:0:14502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c07471 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043148.405019:0:14502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa06a457d6d00) 00010000:00010000:1.0:1789043148.405022:0:14502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789043148.405028:0:14502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c07471 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043148.405034:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c07471 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043148.405115:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75ede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58509587-cde8-42ed-8b49-4691b2633b0c+18:14469:x1875947242508800:12345-192.168.203.17@tcp:54:lfs.0 Request processed in 436us (7922us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043148.405122:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 32 00000100:00100000:2.0:1789043148.409099:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043148.409221:0:14504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242509184 00000100:00100000:0.0:1789043148.409232:0:14504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242509184 00000100:00100000:0.0:1789043148.409287:0:14504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 7 00000100:00100000:0.0:1789043148.409305:0:14504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75edf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58509587-cde8-42ed-8b49-4691b2633b0c+18:14469:x1875947242509184:12345-192.168.203.17@tcp:35:lfs.0 00000100:00100000:0.0:1789043148.409593:0:14504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75edf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58509587-cde8-42ed-8b49-4691b2633b0c+19:14469:x1875947242509184:12345-192.168.203.17@tcp:35:lfs.0 Request processed in 289us (502us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1789043148.409601:0:14504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 7 00000100:00100000:3.0:1789043148.497944:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043148.497998:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043148.498030:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043148.498066:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043148.498094:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043148.498121:0:16375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242509568 00000100:00100000:3.0:1789043148.498129:0:16375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242509568 00000100:00100000:3.0:1789043148.498177:0:16375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242509824 00000100:00100000:3.0:1789043148.498179:0:16375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242509824 00000100:00100000:3.0:1789043148.498190:0:16375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242509440 00000100:00100000:3.0:1789043148.498193:0:16375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242509440 00000100:00100000:3.0:1789043148.498205:0:16375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242509696 00000100:00100000:3.0:1789043148.498208:0:16375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242509696 00000100:00100000:3.0:1789043148.498225:0:16375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00100000:1.0:1789043148.498230:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242509312 00000100:00100000:3.0:1789043148.498238:0:16375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58509587-cde8-42ed-8b49-4691b2633b0c+5:2351:x1875947242509568:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:1.0:1789043148.498239:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242509312 00000100:00100000:1.0:1789043148.498279:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 120 00000100:00100000:1.0:1789043148.498289:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5996c558-d720-4f58-965c-3a1f4ca9bdac+13:2351:x1875947242509312:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1789043148.498304:0:16375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58509587-cde8-42ed-8b49-4691b2633b0c+5:2351:x1875947242509568:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 69us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043148.498312:0:16375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00100000:3.0:1789043148.498328:0:16375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 12 00000100:00100000:1.0:1789043148.498340:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5996c558-d720-4f58-965c-3a1f4ca9bdac+13:2351:x1875947242509312:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 52us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043148.498352:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 120 00000100:00100000:3.0:1789043148.498357:0:16375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+5:2351:x1875947242509824:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1789043148.498388:0:16375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+5:2351:x1875947242509824:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 37us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043148.498395:0:16375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 12 00000100:00100000:3.0:1789043148.498407:0:16375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 13 00000100:00100000:3.0:1789043148.498413:0:16375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58509587-cde8-42ed-8b49-4691b2633b0c+5:2351:x1875947242509440:12345-192.168.203.17@tcp:400:kworker.0 00000100:00100000:3.0:1789043148.498436:0:16375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:58509587-cde8-42ed-8b49-4691b2633b0c+5:2351:x1875947242509440:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 24us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043148.498442:0:16375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 13 00000100:00100000:3.0:1789043148.498454:0:16375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 14 00000100:00100000:3.0:1789043148.498459:0:16375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+5:2351:x1875947242509696:12345-192.168.203.17@tcp:400:kworker.0 00000100:00080000:1.0:1789043148.498496:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789043148.498501:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789043148.499046:0:16375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b857709a-7fd5-4a3a-82ab-b0e6e3c147fd+5:2351:x1875947242509696:12345-192.168.203.17@tcp:400:kworker.0 Request processed in 584us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043148.499053:0:16375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 14 00000040:00080000:0.0:1789043148.723233:0:14533:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789043148.734755:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043148.734889:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242510080 00000100:00100000:0.0:1789043148.734899:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242510080 00000100:00100000:0.0:1789043148.734966:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 33 00000100:00100000:0.0:1789043148.734977:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58509587-cde8-42ed-8b49-4691b2633b0c+19:14501:x1875947242510080:12345-192.168.203.17@tcp:101:cat.0 00010000:00010000:0.0:1789043148.735015:0:14503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789043148.735035:0:14503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c07478 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676dec expref: -99 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.735136:0:14503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418acc00/0x99260d7389c0747f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.735151:0:14503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa069418acc00/0x99260d7389c0747f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.735163:0:14503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa069418acc00/0x99260d7389c0747f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789043148.735175:0:14503:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789043148.735325:0:14503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c07478 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dec expref: 22 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.735346:0:14503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418acc00/0x99260d7389c0747f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dec expref: 21 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.735379:0:14503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa06a457d6d00) 00010000:00010000:0.0:1789043148.735382:0:14503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789043148.735387:0:14503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa069418acc00, rc 0) 00000100:00100000:0.0:1789043148.735461:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58509587-cde8-42ed-8b49-4691b2633b0c+21:14501:x1875947242510080:12345-192.168.203.17@tcp:101:cat.0 Request processed in 485us (714us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1789043148.735468:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 33 00000100:00100000:1.0:1789043148.745275:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043148.745350:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242510336 00000100:00100000:0.0:1789043148.745360:0:14487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242510336 00000100:00100000:0.0:1789043148.745430:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 1 00000100:00100000:0.0:1789043148.745449:0:14487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f837100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58509587-cde8-42ed-8b49-4691b2633b0c+21:2352:x1875947242510336:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789043148.745480:0:14487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789043148.745506:0:14487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa069418acc00/0x99260d7389c0747f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dec expref: 21 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.745567:0:14487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa06a457d6d00) 00010000:00010000:0.0:1789043148.745573:0:14487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789043148.745636:0:14487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f837100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58509587-cde8-42ed-8b49-4691b2633b0c+20:2352:x1875947242510336:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 197us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043148.745643:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 1 00000100:00100000:2.0:1789043148.747781:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043148.747894:0:14504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242510464 00000100:00100000:0.0:1789043148.747908:0:14504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242510464 00000100:00100000:0.0:1789043148.747997:0:14504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 8 00000100:00100000:0.0:1789043148.748015:0:14504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75edc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58509587-cde8-42ed-8b49-4691b2633b0c+20:14501:x1875947242510464:12345-192.168.203.17@tcp:35:cat.0 00000100:00100000:0.0:1789043148.748461:0:14504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75edc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58509587-cde8-42ed-8b49-4691b2633b0c+21:14501:x1875947242510464:12345-192.168.203.17@tcp:35:cat.0 Request processed in 451us (686us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1789043148.748494:0:14504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 8 00000100:00100000:2.0:1789043148.833249:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043148.833563:0:15492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242510720 00000100:00100000:0.0:1789043148.833584:0:15492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242510720 00000100:00100000:0.0:1789043148.833647:0:15492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 34 00000100:00100000:0.0:1789043148.833658:0:15492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75edf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58509587-cde8-42ed-8b49-4691b2633b0c+21:14507:x1875947242510720:12345-192.168.203.17@tcp:101:dd.0 00010000:00010000:0.0:1789043148.833685:0:15492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789043148.833706:0:15492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa069418acc00/0x99260d7389c0748d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676df3 expref: -99 pid: 15492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.833979:0:15492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c07494 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.834006:0:15492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605000/0x99260d7389c07432 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dd0 expref: 22 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.834014:0:15492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac600/0x99260d7389c07447 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dd7 expref: 22 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.834122:0:15492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c07494 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.834158:0:15492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac600/0x99260d7389c07447 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dd7 expref: 22 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.834171:0:15492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac600/0x99260d7389c07447 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dd7 expref: 22 pid: 14501 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043148.834184:0:15492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a763caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15492:1875947267665664:192.168.203.17@tcp:104: 00010000:00010000:0.0:1789043148.834354:0:15492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605000/0x99260d7389c07432 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dd0 expref: 22 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.834363:0:15492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605000/0x99260d7389c07432 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dd0 expref: 22 pid: 14502 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043148.834373:0:15492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a763c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15492:1875947267665792:192.168.203.17@tcp:104: 00000100:00100000:0.0:1789043148.834397:0:15492:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a58592b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789043148.838044:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043148.839141:0:15492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a763caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15492:1875947267665664:192.168.203.17@tcp:104: 00000100:00100000:0.0:1789043148.839158:0:15492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a763c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15492:1875947267665792:192.168.203.17@tcp:104: 00010000:00010000:0.0:1789043148.839182:0:15492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c07494 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043148.839660:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242510848 00000100:00100000:3.0:1789043148.839670:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242510848 00010000:00010000:3.0:1789043148.839726:0:14488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac600/0x99260d7389c07447 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dd7 expref: 23 pid: 14501 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043148.839769:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00100000:3.0:1789043148.839779:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a5244a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58509587-cde8-42ed-8b49-4691b2633b0c+23:2351:x1875947242510848:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789043148.839794:0:14488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789043148.839801:0:14488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac600/0x99260d7389c07447 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dd7 expref: 23 pid: 14501 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043148.839831:0:14488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac600/0x99260d7389c07447 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dd7 expref: 23 pid: 14501 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043148.839852:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ac600/0x99260d7389c07447 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dd7 expref: 23 pid: 14501 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043148.839867:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa06a457d6d00) 00010000:00010000:3.0:1789043148.839872:0:14488:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c07494 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043148.839880:0:14488:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c07494 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043148.839886:0:14488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789043148.839951:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a5244a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58509587-cde8-42ed-8b49-4691b2633b0c+22:2351:x1875947242510848:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 173us (1915us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043148.839958:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00100000:3.0:1789043148.841890:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043148.842928:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242510976 00000100:00100000:0.0:1789043148.842939:0:14486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242510976 00010000:00010000:0.0:1789043148.842983:0:14486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605000/0x99260d7389c07432 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dd0 expref: 22 pid: 14502 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043148.843120:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 12 00000100:00100000:0.0:1789043148.843131:0:14486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58509587-cde8-42ed-8b49-4691b2633b0c+22:2352:x1875947242510976:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789043148.843148:0:14486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789043148.843154:0:14486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605000/0x99260d7389c07432 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dd0 expref: 22 pid: 14502 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.843165:0:14486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605000/0x99260d7389c07432 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dd0 expref: 22 pid: 14502 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.843209:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605000/0x99260d7389c07432 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dd0 expref: 22 pid: 14502 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.843226:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa06a457d6d00) 00010000:00010000:0.0:1789043148.843231:0:14486:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c07494 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.843240:0:14486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c07494 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.843248:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c07494 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.843292:0:14486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789043148.843360:0:14486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58509587-cde8-42ed-8b49-4691b2633b0c+21:2352:x1875947242510976:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 230us (1652us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043148.843367:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 12 00010000:00010000:1.0:1789043148.843429:0:15492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c07494 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043148.843438:0:15492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c07494 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789043148.843458:0:15492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789043148.843654:0:15492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa069418acc00/0x99260d7389c0748d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676df3 expref: 22 pid: 15492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043148.843670:0:15492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418aca00/0x99260d7389c07494 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676df3 expref: 21 pid: 15492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043148.843677:0:15492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa06a457d6d00) 00010000:00010000:1.0:1789043148.843680:0:15492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789043148.843682:0:15492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa069418aca00, rc 0) 00000100:00100000:1.0:1789043148.843708:0:15492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75edf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58509587-cde8-42ed-8b49-4691b2633b0c+21:14507:x1875947242510720:12345-192.168.203.17@tcp:101:dd.0 Request processed in 10053us (10470us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1789043148.843733:0:15492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 34 00000100:00100000:2.0:1789043148.850227:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043148.850385:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242511232 00000100:00100000:0.0:1789043148.850394:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242511232 00000100:00100000:0.0:1789043148.850453:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 35 00000100:00100000:0.0:1789043148.850464:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75eddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58509587-cde8-42ed-8b49-4691b2633b0c+21:14507:x1875947242511232:12345-192.168.203.17@tcp:36:dd.0 00010000:00010000:0.0:1789043148.851033:0:14503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad400/0x99260d7389c074a2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.851052:0:14503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad400/0x99260d7389c074a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.851063:0:14503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad400/0x99260d7389c074a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789043148.851137:0:14503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1789043148.851173:0:14503:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c84d9b6b reply state 00000000fd6dd29f transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad400/0x99260d7389c074a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043148.851182:0:14503:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789043148.851285:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75eddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58509587-cde8-42ed-8b49-4691b2633b0c+24:14507:x1875947242511232:12345-192.168.203.17@tcp:36:dd.0 Request processed in 820us (1065us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1789043148.851293:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 35 00000020:00080000:0.0:1789043148.851298:0:14503:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789043148.857763:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad400/0x99260d7389c074a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043148.857779:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad400/0x99260d7389c074a2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043148.857786:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad400/0x99260d7389c074a2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043148.857791:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa069418ad400 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043148.857796:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad400/0x99260d7389c074a2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043148.857803:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad400/0x99260d7389c074a2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043148.857817:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa06a457d6d00) 00010000:00010000:2.0:1789043148.857820:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043148.857824:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad400/0x99260d7389c074a2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043148.857830:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad400/0x99260d7389c074a2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043148.862073:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043148.862461:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242511360 00000100:00100000:1.0:1789043148.862472:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242511360 00000100:00100000:1.0:1789043148.862557:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 36 00000100:00100000:1.0:1789043148.862567:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75eddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58509587-cde8-42ed-8b49-4691b2633b0c+23:14507:x1875947242511360:12345-192.168.203.17@tcp:101:dd.0 00010000:00010000:1.0:1789043148.862592:0:14502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043148.862610:0:14502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c074a9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676dfa expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043148.862665:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c074a9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dfa expref: 24 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043148.862679:0:14502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c074a9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dfa expref: 24 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043148.862697:0:14502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa06a457d6d00) 00010000:00010000:1.0:1789043148.862700:0:14502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789043148.862704:0:14502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41686800, rc 0) 00000100:00100000:1.0:1789043148.862775:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75eddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58509587-cde8-42ed-8b49-4691b2633b0c+24:14507:x1875947242511360:12345-192.168.203.17@tcp:101:dd.0 Request processed in 208us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043148.862783:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 36 00000100:00100000:3.0:1789043148.915222:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043148.915488:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242511616 00000100:00100000:2.0:1789043148.915499:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242511616 00000100:00100000:2.0:1789043148.915601:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 2 00000100:00100000:2.0:1789043148.915631:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58509587-cde8-42ed-8b49-4691b2633b0c+24:14507:x1875947242511616:12345-192.168.203.17@tcp:103:dd.0 00010000:00010000:2.0:1789043148.915647:0:14488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789043148.915671:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c074a9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676dfa expref: 24 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043148.915701:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa06a457d6d00) 00010000:00010000:2.0:1789043148.915706:0:14488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789043148.915773:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58509587-cde8-42ed-8b49-4691b2633b0c+23:14507:x1875947242511616:12345-192.168.203.17@tcp:103:dd.0 Request processed in 144us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043148.915780:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 2 00000100:00100000:2.0:1789043148.920310:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043148.922164:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242511744 00000100:00100000:0.0:1789043148.922179:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242511744 00000100:00100000:0.0:1789043148.922258:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 37 00000100:00100000:0.0:1789043148.922269:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75edfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58509587-cde8-42ed-8b49-4691b2633b0c+23:14507:x1875947242511744:12345-192.168.203.17@tcp:58:dd.0 00010000:00010000:0.0:1789043148.922367:0:14503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad800/0x99260d7389c074b0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.922383:0:14503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad800/0x99260d7389c074b0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043148.922396:0:14503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad800/0x99260d7389c074b0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789043148.923320:0:14503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789043148.923467:0:14503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1789043148.923568:0:14503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1789043148.923687:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75edfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58509587-cde8-42ed-8b49-4691b2633b0c+23:14507:x1875947242511744:12345-192.168.203.17@tcp:58:dd.0 Request processed in 1416us (3381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043148.923697:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 37 00000100:00100000:3.0:1789043148.930999:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043148.931107:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242511872 00000100:00100000:1.0:1789043148.931118:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242511872 00000100:00100000:1.0:1789043148.931175:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 38 00000100:00100000:1.0:1789043148.931184:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58509587-cde8-42ed-8b49-4691b2633b0c+23:14507:x1875947242511872:12345-192.168.203.17@tcp:101:dd.0 00010000:00010000:1.0:1789043148.931205:0:14502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043148.931224:0:14502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686000/0x99260d7389c074b7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676e01 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043148.931314:0:14502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad800/0x99260d7389c074b0 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043148.931325:0:14502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686000/0x99260d7389c074b7 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e01 expref: 24 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043148.931344:0:14502:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad800/0x99260d7389c074b0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043148.931356:0:14502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686000/0x99260d7389c074b7 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e01 expref: 24 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043148.931367:0:14502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa06a457d6d00) 00010000:00010000:1.0:1789043148.931369:0:14502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789043148.931373:0:14502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686000/0x99260d7389c074b7 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e01 expref: 24 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043148.931380:0:14502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41686000, rc 0) 00000100:00100000:1.0:1789043148.931443:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58509587-cde8-42ed-8b49-4691b2633b0c+24:14507:x1875947242511872:12345-192.168.203.17@tcp:101:dd.0 Request processed in 259us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043148.931449:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 38 00000100:00100000:0.0:1789043149.042865:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789043149.043077:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267665920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789043149.043143:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043149.043353:0:15189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267665920 00000100:00100000:3.0:1789043149.043361:0:15189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267665920 00000100:00100000:3.0:1789043149.043476:0:15189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789043149.043486:0:15189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267665920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789043149.043541:0:15189:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789043149.043601:0:15189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267665920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043149.043621:0:15189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789043149.043713:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75eded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267665920:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789043149.043847:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789043149.426787:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789043149.747339:0:14533:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789043149.747348:0:14533:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789043149.747416:0:14533:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789043149.747426:0:14533:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789043149.747583:0:14533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a763caa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14533:1875947267666048:192.168.203.17@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789043149.747689:0:14533:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a58592b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789043149.751762:0:14533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a763caa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14533:1875947267666048:192.168.203.17@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789043149.757558:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043149.757719:0:14512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242512000 00000100:00100000:0.0:1789043149.757729:0:14512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242512000 00000100:00100000:0.0:1789043149.757792:0:14512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 0 00000100:00100000:0.0:1789043149.757803:0:14512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:58509587-cde8-42ed-8b49-4691b2633b0c+24:14509:x1875947242512000:12345-192.168.203.17@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789043149.757903:0:14512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:58509587-cde8-42ed-8b49-4691b2633b0c+24:14509:x1875947242512000:12345-192.168.203.17@tcp:900:lhsmtool_posix.0 Request processed in 102us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043149.757911:0:14512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 0 00000100:00080000:1.0:1789043149.758335:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789043149.768957:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043149.769027:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242512128 00000100:00100000:3.0:1789043149.769038:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242512128 00000100:00100000:3.0:1789043149.769190:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 39 00000100:00100000:3.0:1789043149.769202:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58509587-cde8-42ed-8b49-4691b2633b0c+24:14509:x1875947242512128:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789043149.769238:0:14501:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789043149.769358:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58509587-cde8-42ed-8b49-4691b2633b0c+24:14509:x1875947242512128:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 Request processed in 157us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043149.769366:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 39 00000100:00100000:2.0:1789043149.781614:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043149.781699:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242512256 00000100:00100000:1.0:1789043149.781710:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242512256 00000100:00100000:1.0:1789043149.781781:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 40 00000100:00100000:1.0:1789043149.781791:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75eded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58509587-cde8-42ed-8b49-4691b2633b0c+24:14509:x1875947242512256:12345-192.168.203.17@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789043149.781881:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c074be lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.781898:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c074be lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.781911:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c074be lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.781971:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c074c5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.781990:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c074c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.781998:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c074c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.782021:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c074cc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.782030:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c074cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.782037:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c074cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789043149.782077:0:14502:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789043149.782355:0:14502:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789043149.782374:0:14502:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c074cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.782386:0:14502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c074be lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.782398:0:14502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c074be lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.782406:0:14502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c074be lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.782413:0:14502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686600 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043149.782417:0:14502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c074be lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.782425:0:14502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c074be lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.782436:0:14502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa06a457d6800) 00010000:00010000:1.0:1789043149.782439:0:14502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043149.782444:0:14502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c074be lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.782451:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c074be lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.782466:0:14502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c074c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.782471:0:14502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c074c5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.782477:0:14502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c074c5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.782483:0:14502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686800 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043149.782491:0:14502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c074c5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.782498:0:14502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c074c5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.782505:0:14502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffffa06a44e19300) 00010000:00010000:1.0:1789043149.782508:0:14502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043149.782510:0:14502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c074c5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.782572:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c074c5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.782588:0:14502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c074cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.782593:0:14502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c074cc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.782599:0:14502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c074cc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.782603:0:14502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687e00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043149.782606:0:14502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c074cc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.782611:0:14502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c074cc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.782619:0:14502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa06a457d6d00) 00010000:00010000:1.0:1789043149.782621:0:14502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043149.782630:0:14502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c074cc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.782636:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c074cc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043149.782707:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75eded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58509587-cde8-42ed-8b49-4691b2633b0c+24:14509:x1875947242512256:12345-192.168.203.17@tcp:34:lhsmtool_posix.0 Request processed in 915us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043149.782715:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 40 00000100:00100000:1.0:1789043149.788969:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043149.789069:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242512512 00000100:00100000:0.0:1789043149.789088:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242512512 00000100:00100000:0.0:1789043149.789147:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 41 00000100:00100000:0.0:1789043149.789158:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58509587-cde8-42ed-8b49-4691b2633b0c+24:14509:x1875947242512512:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789043149.789179:0:14503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789043149.789199:0:14503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa069418adc00/0x99260d7389c074d3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676e08 expref: -99 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043149.789298:0:14503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad400/0x99260d7389c074da lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043149.789330:0:14503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad400/0x99260d7389c074da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043149.789342:0:14503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad400/0x99260d7389c074da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789043149.789356:0:14503:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789043149.789469:0:14503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad400/0x99260d7389c074da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043149.789477:0:14503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad400/0x99260d7389c074da lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043149.789484:0:14503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad400/0x99260d7389c074da lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043149.789489:0:14503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa069418ad400 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:0.0:1789043149.789494:0:14503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad400/0x99260d7389c074da lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043149.789501:0:14503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad400/0x99260d7389c074da lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043149.789551:0:14503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa06a457d6d00) 00010000:00010000:0.0:1789043149.789554:0:14503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789043149.789559:0:14503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad400/0x99260d7389c074da lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043149.789565:0:14503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad400/0x99260d7389c074da lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043149.789604:0:14503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418adc00/0x99260d7389c074d3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e08 expref: 26 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043149.789621:0:14503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa06a457d6800) 00010000:00010000:0.0:1789043149.789624:0:14503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789043149.789627:0:14503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa069418adc00/0x99260d7389c074d3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e08 expref: 26 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043149.789636:0:14503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa069418adc00, rc 0) 00000100:00100000:0.0:1789043149.789687:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58509587-cde8-42ed-8b49-4691b2633b0c+25:14509:x1875947242512512:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 532us (728us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1789043149.789694:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 41 00000100:00100000:3.0:1789043149.794235:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043149.794394:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242512640 00000100:00100000:1.0:1789043149.794406:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242512640 00000100:00100000:1.0:1789043149.794479:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 42 00000100:00100000:1.0:1789043149.794490:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58509587-cde8-42ed-8b49-4691b2633b0c+25:14509:x1875947242512640:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789043149.794573:0:14502:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789043149.794717:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58509587-cde8-42ed-8b49-4691b2633b0c+25:14509:x1875947242512640:12345-192.168.203.17@tcp:53:lhsmtool_posix.0 Request processed in 227us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043149.794724:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 42 00000100:00100000:2.0:1789043149.811552:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043149.811666:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242512896 00000100:00100000:0.0:1789043149.811677:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242512896 00000100:00100000:0.0:1789043149.811736:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 43 00000100:00100000:0.0:1789043149.811763:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75edd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58509587-cde8-42ed-8b49-4691b2633b0c+25:14509:x1875947242512896:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789043149.811784:0:14503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789043149.811805:0:14503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa069418adc00/0x99260d7389c074e8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676e0f expref: -99 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789043149.812456:0:14503:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:0.0:1789043149.812464:0:14503:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1789043149.812509:0:14503:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1789043149.812830:0:14503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad400/0x99260d7389c074ef lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043149.812845:0:14503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad400/0x99260d7389c074ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043149.812855:0:14503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad400/0x99260d7389c074ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043149.812923:0:14503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa069418adc00/0x99260d7389c074e8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e0f expref: 28 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043149.812941:0:14503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad400/0x99260d7389c074ef lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e0f expref: 27 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043149.812949:0:14503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa06a42b36900) 00010000:00010000:0.0:1789043149.812951:0:14503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789043149.812954:0:14503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa069418ad400, rc 0) 00000100:00100000:0.0:1789043149.813033:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75edd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58509587-cde8-42ed-8b49-4691b2633b0c+27:14509:x1875947242512896:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 1272us (1526us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1789043149.813042:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 43 00000100:00100000:2.0:1789043149.823152:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043149.823751:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242513152 00000100:00100000:1.0:1789043149.823761:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242513152 00000100:00100000:1.0:1789043149.823829:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 44 00000100:00100000:1.0:1789043149.823841:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75ede300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58509587-cde8-42ed-8b49-4691b2633b0c+27:14509:x1875947242513152:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789043149.823899:0:14502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789043149.823926:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad400/0x99260d7389c074ef lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e0f expref: 27 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.823947:0:14502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa06a42b36900) 00010000:00010000:1.0:1789043149.823957:0:14502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789043149.824008:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c074fd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.824028:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c074fd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.824039:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c074fd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.824089:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c07504 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x565f2720 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.824097:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c07504 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x565f2720 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.824104:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c07504 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x565f2720 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.824161:0:14502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c074fd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.824168:0:14502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c074fd lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.824175:0:14502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c074fd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.824181:0:14502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687e00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043149.824186:0:14502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c074fd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.824193:0:14502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c074fd lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.824210:0:14502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa06a457d6f00) 00010000:00010000:1.0:1789043149.824213:0:14502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043149.824217:0:14502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c074fd lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.824223:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687e00/0x99260d7389c074fd lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.824233:0:14502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c07504 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x565f2720 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.824239:0:14502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c07504 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x565f2720 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.824244:0:14502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c07504 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x565f2720 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.824250:0:14502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686800 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043149.824253:0:14502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c07504 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x565f2720 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.824259:0:14502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c07504 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x565f2720 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.824266:0:14502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x565f2720 (ffffa06a44e19300) 00010000:00010000:1.0:1789043149.824268:0:14502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043149.824271:0:14502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c07504 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x565f2720 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.824275:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c07504 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x565f2720 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043149.824379:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75ede300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58509587-cde8-42ed-8b49-4691b2633b0c+26:14509:x1875947242513152:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 Request processed in 540us (1235us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789043149.824387:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 44 00000100:00100000:3.0:1789043149.829792:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043149.830315:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242513280 00000100:00100000:1.0:1789043149.830327:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242513280 00000100:00100000:1.0:1789043149.830414:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 45 00000100:00100000:1.0:1789043149.830425:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58509587-cde8-42ed-8b49-4691b2633b0c+26:14509:x1875947242513280:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789043149.830444:0:14501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043149.830465:0:14501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c0750b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676e16 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.830504:0:14501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c07512 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.830537:0:14501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c07512 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.830549:0:14501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c07512 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.830654:0:14501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686600/0x99260d7389c0750b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e16 expref: 28 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.830672:0:14501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41687200/0x99260d7389c07512 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e16 expref: 27 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.830680:0:14501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:1.0:1789043149.830692:0:14501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789043149.830695:0:14501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41687200, rc 0) 00000100:00100000:1.0:1789043149.831409:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58509587-cde8-42ed-8b49-4691b2633b0c+27:14509:x1875947242513280:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 983us (2043us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043149.831417:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 45 00000100:00100000:3.0:1789043149.840241:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043149.841018:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242513536 00000100:00100000:1.0:1789043149.841095:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242513536 00000100:00100000:1.0:1789043149.841199:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 46 00000100:00100000:1.0:1789043149.841210:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58509587-cde8-42ed-8b49-4691b2633b0c+27:14509:x1875947242513536:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789043149.841291:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c07519 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.841309:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c07519 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.841321:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c07519 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789043149.841771:0:14502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1789043149.841781:0:14502:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 492798266057ns, next at 493798264211ns, rc = 0 00000004:00010000:1.0:1789043149.841861:0:14502:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000022489550 reply state 00000000fd5bb4cb transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c07519 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043149.841872:0:14502:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789043149.841961:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:58509587-cde8-42ed-8b49-4691b2633b0c+29:14509:x1875947242513536:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 Request processed in 751us (1728us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1789043149.841969:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 46 00010000:00010000:2.0:1789043149.846680:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c07519 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043149.846699:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c07519 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043149.846707:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c07519 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043149.846714:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686800 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043149.846719:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c07519 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043149.846752:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c07519 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043149.846770:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:2.0:1789043149.846773:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789043149.846778:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c07519 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043149.846786:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c07519 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043149.852108:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043149.852201:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242513664 00000100:00100000:2.0:1789043149.852212:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242513664 00000100:00100000:2.0:1789043149.852276:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 47 00000100:00100000:2.0:1789043149.852286:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a46ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58509587-cde8-42ed-8b49-4691b2633b0c+28:14509:x1875947242513664:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789043149.852311:0:14503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043149.852332:0:14503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604200/0x99260d7389c07520 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676e1d expref: -99 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043149.852388:0:14503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604200/0x99260d7389c07520 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e1d expref: 29 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043149.852403:0:14503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604200/0x99260d7389c07520 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e1d expref: 29 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043149.852420:0:14503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:2.0:1789043149.852423:0:14503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789043149.852427:0:14503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a58604200, rc 0) 00000100:00100000:2.0:1789043149.852510:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a46ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58509587-cde8-42ed-8b49-4691b2633b0c+29:14509:x1875947242513664:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 226us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043149.852559:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 47 00000100:00100000:3.0:1789043149.858495:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043149.859171:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242513792 00000100:00100000:1.0:1789043149.859182:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242513792 00000100:00100000:1.0:1789043149.859305:0:15188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 12 00000100:00100000:1.0:1789043149.859315:0:15188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a026a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58509587-cde8-42ed-8b49-4691b2633b0c+5:2351:x1875947242513792:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789043149.859817:0:15188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a026a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58509587-cde8-42ed-8b49-4691b2633b0c+6:2351:x1875947242513792:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 Request processed in 502us (1330us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789043149.859825:0:15188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 12 00000100:00100000:3.0:1789043149.874904:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043149.875109:0:14504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242514048 00000100:00100000:0.0:1789043149.875118:0:14504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242514048 00000100:00100000:0.0:1789043149.875172:0:14504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 9 00000100:00100000:0.0:1789043149.875180:0:14504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7a027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58509587-cde8-42ed-8b49-4691b2633b0c+29:14509:x1875947242514048:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789043149.875421:0:14504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7a027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58509587-cde8-42ed-8b49-4691b2633b0c+30:14509:x1875947242514048:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 Request processed in 240us (525us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1789043149.875429:0:14504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 9 00000100:00100000:3.0:1789043149.879050:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043149.879221:0:15492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242514304 00000100:00100000:0.0:1789043149.879230:0:15492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242514304 00000100:00100000:0.0:1789043149.879292:0:15492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 48 00000100:00100000:0.0:1789043149.879302:0:15492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58509587-cde8-42ed-8b49-4691b2633b0c+30:14509:x1875947242514304:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789043149.879432:0:15492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58509587-cde8-42ed-8b49-4691b2633b0c+30:14509:x1875947242514304:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 Request processed in 132us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043149.879469:0:15492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 48 00000100:00100000:3.0:1789043149.883921:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043149.884634:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242514432 00000100:00100000:2.0:1789043149.884646:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242514432 00000100:00100000:2.0:1789043149.884709:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 49 00000100:00100000:2.0:1789043149.884719:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58509587-cde8-42ed-8b49-4691b2633b0c+30:14509:x1875947242514432:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789043149.884740:0:14503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789043149.884761:0:14503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605000/0x99260d7389c07527 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676e24 expref: -99 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043149.884830:0:14503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605a00/0x99260d7389c0752e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043149.884858:0:14503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605a00/0x99260d7389c0752e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043149.884871:0:14503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605a00/0x99260d7389c0752e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789043149.884908:0:14503:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789043149.884927:0:14503:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605a00/0x99260d7389c0752e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043149.884952:0:14503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605000/0x99260d7389c07527 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e24 expref: 32 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043149.884970:0:14503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605a00/0x99260d7389c0752e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e24 expref: 31 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043149.885013:0:14503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:2.0:1789043149.885016:0:14503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789043149.885020:0:14503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a58605a00, rc 0) 00000100:00100000:2.0:1789043149.885124:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58509587-cde8-42ed-8b49-4691b2633b0c+31:14509:x1875947242514432:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 406us (1212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043149.885130:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 49 00000100:00100000:3.0:1789043149.892320:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043149.892440:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242514560 00000100:00100000:0.0:1789043149.892465:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242514560 00000100:00100000:0.0:1789043149.892556:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 13 00000100:00100000:0.0:1789043149.892567:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58509587-cde8-42ed-8b49-4691b2633b0c+6:2352:x1875947242514560:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789043149.892586:0:15187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789043149.892607:0:15187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dbc3023b/0x99260d7389c07535 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676e2b expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789043149.892648:0:15187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa2a1ce, blocks: 0x1 00010000:00010000:0.0:1789043149.892666:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1789043149.892670:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043149.892681:0:15187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbc3023b/0x99260d7389c07535 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e2b expref: 7 pid: 15187 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043149.892699:0:15187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dbc3023b/0x99260d7389c07535 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e2b expref: 7 pid: 15187 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043149.892713:0:15187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa069418adc00, rc 0) 00000100:00100000:0.0:1789043149.892768:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58509587-cde8-42ed-8b49-4691b2633b0c+7:2352:x1875947242514560:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 203us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043149.892776:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 13 00000100:00100000:2.0:1789043149.898625:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043149.898772:0:15492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242514816 00000100:00100000:0.0:1789043149.898782:0:15492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242514816 00000100:00100000:0.0:1789043149.898835:0:15492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 50 00000100:00100000:0.0:1789043149.898845:0:15492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a75edd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58509587-cde8-42ed-8b49-4691b2633b0c+31:14509:x1875947242514816:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789043149.898974:0:15492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a75edd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58509587-cde8-42ed-8b49-4691b2633b0c+31:14509:x1875947242514816:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 Request processed in 130us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043149.898991:0:15492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 50 00000100:00100000:1.0:1789043149.904385:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043149.904588:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242514944 00000100:00100000:3.0:1789043149.904598:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242514944 00000100:00100000:3.0:1789043149.904673:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 51 00000100:00100000:3.0:1789043149.904684:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58509587-cde8-42ed-8b49-4691b2633b0c+31:14509:x1875947242514944:12345-192.168.203.17@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1789043149.954506:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:58509587-cde8-42ed-8b49-4691b2633b0c+31:14509:x1875947242514944:12345-192.168.203.17@tcp:44:lhsmtool_posix.0 Request processed in 49814us (50121us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043149.954539:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 51 00000001:00080000:0.0:1789043149.956388:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:0.0:1789043149.956425:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000004:00080000:0.0:1789043149.956435:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1789043149.956478:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1789043149.957246:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a75edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267666176:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789043149.957311:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043149.957971:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043149.958120:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267666176 00000100:00100000:1.0:1789043149.958129:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267666176 00000100:00100000:1.0:1789043149.958186:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242515072 00000100:00100000:1.0:1789043149.958189:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242515072 00000100:00100000:1.0:1789043149.958210:0:15188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789043149.958218:0:15188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267666176:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789043149.958392:0:15188:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789043149.958396:0:15188:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00000100:00100000:0.0:1789043149.958399:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 15 00002000:00010000:1.0:1789043149.958400:0:15188:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789043149.958405:0:15188:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789043150 -> 1789043150 00002000:00010000:1.0:1789043149.958408:0:15188:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789043149.958414:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58509587-cde8-42ed-8b49-4691b2633b0c+7:2352:x1875947242515072:12345-192.168.203.17@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789043149.958458:0:15188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1875947267666176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 240us (1146us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1789043149.958467:0:15188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789043149.958501:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58509587-cde8-42ed-8b49-4691b2633b0c+7:2352:x1875947242515072:12345-192.168.203.17@tcp:16:lhsmtool_posix.0 Request processed in 90us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043149.958508:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 15 00000004:00080000:0.0:1789043149.958579:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa06a75edc000/2, rc 0, transno 8589934595 00000100:00100000:0.0:1789043149.958587:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a75edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267666176:0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1789043149.960151:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789043149.963277:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043149.963385:0:15492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242515328 00000100:00100000:0.0:1789043149.963395:0:15492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242515328 00000100:00100000:0.0:1789043149.963744:0:15492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 52 00000100:00100000:0.0:1789043149.963756:0:15492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58509587-cde8-42ed-8b49-4691b2633b0c+14:14509:x1875947242515328:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789043149.963807:0:15492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789043149.963832:0:15492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605a00/0x99260d7389c0752e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e24 expref: 14 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043149.963874:0:15492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:0.0:1789043149.963879:0:15492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789043149.963909:0:15492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418acc00/0x99260d7389c0753c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043149.963922:0:15492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa069418acc00/0x99260d7389c0753c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043149.963933:0:15492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa069418acc00/0x99260d7389c0753c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789043149.964217:0:15492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae0db34e reply state 0000000002b57023 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffffa069418acc00/0x99260d7389c0753c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043149.964227:0:15492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789043149.964366:0:15492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:58509587-cde8-42ed-8b49-4691b2633b0c+15:14509:x1875947242515328:12345-192.168.203.17@tcp:36:lhsmtool_posix.0 Request processed in 612us (1209us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1789043149.964374:0:15492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 52 00000100:00100000:3.0:1789043149.968258:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043149.968332:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242515456 00000100:00100000:1.0:1789043149.968343:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242515456 00000100:00100000:1.0:1789043149.968399:0:15188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 16 00000100:00100000:1.0:1789043149.968409:0:15188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a767e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58509587-cde8-42ed-8b49-4691b2633b0c+7:14509:x1875947242515456:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789043149.968428:0:15188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789043149.968460:0:15188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c07543 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xea0b4a70ca676e32 expref: -99 pid: 15188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.968539:0:15188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dbc3023b/0x99260d7389c07535 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e2b expref: 8 pid: 15187 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.968549:0:15188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789043149.968553:0:15188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789043149.968558:0:15188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c07543 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e32 expref: 8 pid: 15188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.968590:0:15188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dbc3023b/0x99260d7389c07535 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e2b expref: 8 pid: 15187 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043149.968603:0:15188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dbc3023b/0x99260d7389c07535 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e2b expref: 8 pid: 15187 timeout: 592 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043149.968627:0:15188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f834700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15188:1875947267666304:192.168.203.17@tcp:104: 00000100:00100000:1.0:1789043149.968706:0:15188:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a482869c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789043149.970660:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418acc00/0x99260d7389c0753c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043149.970676:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa069418acc00/0x99260d7389c0753c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043149.970684:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa069418acc00/0x99260d7389c0753c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043149.970690:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa069418acc00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:2.0:1789043149.970695:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa069418acc00/0x99260d7389c0753c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043149.970703:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa069418acc00/0x99260d7389c0753c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043149.970719:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:2.0:1789043149.970722:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789043149.970727:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa069418acc00/0x99260d7389c0753c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043149.970734:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa069418acc00/0x99260d7389c0753c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043149.974638:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043149.974814:0:15188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f834700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15188:1875947267666304:192.168.203.17@tcp:104: 00010000:00010000:0.0:1789043149.974848:0:15188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c07543 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e32 expref: 8 pid: 15188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043149.974868:0:15188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa06a41687e00, rc 0) 00000100:00100000:0.0:1789043149.974932:0:15188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a767e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:58509587-cde8-42ed-8b49-4691b2633b0c+8:14509:x1875947242515456:12345-192.168.203.17@tcp:101:lhsmtool_posix.0 Request processed in 6524us (6682us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043149.974941:0:15188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 16 00000100:00100000:3.0:1789043149.975078:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242515584 00000100:00100000:3.0:1789043149.975086:0:14486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242515584 00010000:00010000:3.0:1789043149.975118:0:14486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dbc3023b/0x99260d7389c07535 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e2b expref: 8 pid: 15187 timeout: 592 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043149.975155:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 13 00000100:00100000:3.0:1789043149.975165:0:14486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f837480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58509587-cde8-42ed-8b49-4691b2633b0c+8:2352:x1875947242515584:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789043149.975178:0:14486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789043149.975201:0:14486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dbc3023b/0x99260d7389c07535 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e2b expref: 8 pid: 15187 timeout: 592 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043149.975214:0:14486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dbc3023b/0x99260d7389c07535 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e2b expref: 8 pid: 15187 timeout: 592 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043149.975236:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbc3023b/0x99260d7389c07535 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e2b expref: 8 pid: 15187 timeout: 592 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043149.975249:0:14486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789043149.975254:0:14486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789043149.975261:0:14486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c07543 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e32 expref: 7 pid: 15188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043149.975271:0:14486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c07543 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e32 expref: 7 pid: 15188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043149.975326:0:14486:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c07543 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e32 expref: 7 pid: 15188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043149.975340:0:14486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14486:1875947267666432:192.168.203.17@tcp:105: 00000100:00100000:3.0:1789043149.975391:0:14486:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a45627780 going to sleep for 11 seconds 00000100:00100000:0.0:1789043149.980016:0:14486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14486:1875947267666432:192.168.203.17@tcp:105: 00010000:00010000:0.0:1789043149.980063:0:14486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789043149.980127:0:14486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f837480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58509587-cde8-42ed-8b49-4691b2633b0c+7:2352:x1875947242515584:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 4963us (5498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043149.980138:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 13 00000100:00100000:1.0:1789043149.984273:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043149.984376:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242515712 00000100:00100000:2.0:1789043149.984386:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242515712 00000100:00100000:2.0:1789043149.984445:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 17 00000100:00100000:2.0:1789043149.984816:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f835500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58509587-cde8-42ed-8b49-4691b2633b0c+7:2352:x1875947242515712:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789043149.985012:0:15185:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789043149.985016:0:15185:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789043149 00002000:00010000:2.0:1789043149.985019:0:15185:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789043148 00002000:00010000:2.0:1789043149.985021:0:15185:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789043150 -> 1789043149 00002000:00010000:2.0:1789043149.985023:0:15185:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789043149.985091:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f835500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:58509587-cde8-42ed-8b49-4691b2633b0c+8:2352:x1875947242515712:12345-192.168.203.17@tcp:2:lhsmtool_posix.0 Request processed in 279us (828us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789043149.989494:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 17 00000100:00100000:0.0:1789043149.989919:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043149.990020:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242515840 00000100:00100000:2.0:1789043149.990029:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242515840 00000100:00100000:2.0:1789043149.990170:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 18 00000100:00100000:2.0:1789043149.990181:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58509587-cde8-42ed-8b49-4691b2633b0c+8:2351:x1875947242515840:12345-192.168.203.17@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789043149.990227:0:15187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000149b1f69/0x99260d7389c0754a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043149.990247:0:15187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c07543 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e32 expref: 8 pid: 15188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043149.990256:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789043149.990259:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789043149.990263:0:15187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000149b1f69/0x99260d7389c0754a lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043149.990322:0:15187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c07543 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e32 expref: 8 pid: 15188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043149.990337:0:15187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c07543 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e32 expref: 8 pid: 15188 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043149.990352:0:15187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f85dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15187:1875947267666560:192.168.203.17@tcp:104: 00000100:00100000:2.0:1789043149.990430:0:15187:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a52c30f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789043149.993313:0:15187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f85dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15187:1875947267666560:192.168.203.17@tcp:104: 00010000:00010000:2.0:1789043149.993340:0:15187:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000149b1f69/0x99260d7389c0754a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043149.994383:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043149.994470:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242515968 00000100:00100000:2.0:1789043149.994477:0:14487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242515968 00010000:00010000:2.0:1789043149.994510:0:14487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c07543 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e32 expref: 9 pid: 15188 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043149.994572:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 14 00000100:00100000:2.0:1789043149.994580:0:14487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58509587-cde8-42ed-8b49-4691b2633b0c+9:2352:x1875947242515968:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789043149.994593:0:14487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789043149.994621:0:14487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c07543 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e32 expref: 9 pid: 15188 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043149.994655:0:14487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c07543 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e32 expref: 9 pid: 15188 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043149.994678:0:14487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c07543 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e32 expref: 9 pid: 15188 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043149.994695:0:14487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789043149.994699:0:14487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789043149.994705:0:14487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000149b1f69/0x99260d7389c0754a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043149.994715:0:14487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000149b1f69/0x99260d7389c0754a lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043149.994734:0:14487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789043149.994782:0:14487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58509587-cde8-42ed-8b49-4691b2633b0c+8:2352:x1875947242515968:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 203us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043149.994790:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 14 00010000:00010000:0.0:1789043149.995198:0:15187:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000149b1f69/0x99260d7389c0754a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043149.995210:0:15187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000149b1f69/0x99260d7389c0754a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043149.995233:0:15187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000149b1f69/0x99260d7389c0754a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043149.995241:0:15187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000149b1f69/0x99260d7389c0754a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043149.995250:0:15187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000149b1f69/0x99260d7389c0754a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043149.995258:0:15187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a58605c00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789043149.995261:0:15187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000149b1f69/0x99260d7389c0754a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043149.995270:0:15187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000149b1f69/0x99260d7389c0754a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043149.995290:0:15187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000149b1f69/0x99260d7389c0754a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043149.995297:0:15187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000149b1f69/0x99260d7389c0754a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043149.995354:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:58509587-cde8-42ed-8b49-4691b2633b0c+7:2351:x1875947242515840:12345-192.168.203.17@tcp:1:lhsmtool_posix.0 Request processed in 5174us (5437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789043149.995361:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 18 00000100:00100000:0.0:1789043150.004019:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043150.004116:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242516224 00000100:00100000:2.0:1789043150.004125:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242516224 00000100:00100000:2.0:1789043150.004185:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 53 00000100:00100000:2.0:1789043150.004195:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58509587-cde8-42ed-8b49-4691b2633b0c+14:14509:x1875947242516224:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789043150.004275:0:14503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605c00/0x99260d7389c07551 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043150.004310:0:14503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605c00/0x99260d7389c07551 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043150.004323:0:14503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605c00/0x99260d7389c07551 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043150.004599:0:14503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605a00/0x99260d7389c07558 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043150.004623:0:14503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604200/0x99260d7389c07520 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e1d expref: 15 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043150.004634:0:14503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605a00/0x99260d7389c07558 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043150.004668:0:14503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604200/0x99260d7389c07520 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e1d expref: 15 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043150.004683:0:14503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604200/0x99260d7389c07520 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e1d expref: 15 pid: 14503 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043150.004696:0:14503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f85dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14503:1875947267666688:192.168.203.17@tcp:104: 00000100:00100000:2.0:1789043150.004772:0:14503:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a52c30f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789043150.009137:0:14503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f85dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14503:1875947267666688:192.168.203.17@tcp:104: 00010000:00010000:2.0:1789043150.009167:0:14503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605a00/0x99260d7389c07558 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043150.009221:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043150.009325:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242516352 00000100:00100000:3.0:1789043150.009334:0:14486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242516352 00010000:00010000:3.0:1789043150.009370:0:14486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604200/0x99260d7389c07520 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e1d expref: 16 pid: 14503 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043150.009408:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 15 00000100:00100000:3.0:1789043150.009418:0:14486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58509587-cde8-42ed-8b49-4691b2633b0c+16:2351:x1875947242516352:12345-192.168.203.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789043150.009431:0:14486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789043150.009702:0:14486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604200/0x99260d7389c07520 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e1d expref: 16 pid: 14503 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043150.009717:0:14486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604200/0x99260d7389c07520 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e1d expref: 16 pid: 14503 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043150.009741:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58604200/0x99260d7389c07520 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e1d expref: 16 pid: 14503 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043150.009758:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:3.0:1789043150.009763:0:14486:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605a00/0x99260d7389c07558 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043150.009790:0:14486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605a00/0x99260d7389c07558 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043150.009798:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605a00/0x99260d7389c07558 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043150.009863:0:14486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789043150.009956:0:14486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58509587-cde8-42ed-8b49-4691b2633b0c+15:2351:x1875947242516352:12345-192.168.203.17@tcp:103:ldlm_bl.0 Request processed in 538us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043150.009965:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 15 00010000:00010000:2.0:1789043150.010016:0:14503:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605a00/0x99260d7389c07558 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043150.010032:0:14503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605a00/0x99260d7389c07558 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789043150.010223:0:14503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1789043150.010370:0:14503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1789043150.010414:0:14503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1789043150.010913:0:14503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f8c5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14503:1875947267666816:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789043150.011012:0:14503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043150.011049:0:14503:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a45627cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789043150.011114:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267666816 00000100:00100000:2.0:1789043150.011121:0:14506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267666816 00000100:00100000:2.0:1789043150.011160:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789043150.011168:0:14506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f8c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14503:x1875947267666816:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789043150.011306:0:14506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f8c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14503:x1875947267666816:12345-0@lo:1000:mdt00_002.0 Request processed in 137us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043150.011313:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789043150.013178:0:14503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f8c5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14503:1875947267666816:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1789043150.014145:0:14503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1789043150.014228:0:14503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f834000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14503:1875947267666944:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789043150.014287:0:14503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043150.014378:0:14503:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a41254180 going to sleep for 11 seconds 00000100:00100000:2.0:1789043150.015017:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267666944 00000100:00100000:2.0:1789043150.015026:0:14506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267666944 00000100:00100000:0.0:1789043150.015182:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789043150.015191:0:14506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14503:x1875947267666944:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789043150.015387:0:14506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14503:x1875947267666944:12345-0@lo:1000:mdt00_002.0 Request processed in 196us (1099us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1789043150.015395:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789043150.015476:0:14503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f834000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14503:1875947267666944:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1789043150.015551:0:14503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605a00/0x99260d7389c07558 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.015562:0:14503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605a00/0x99260d7389c07558 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.015570:0:14503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605a00/0x99260d7389c07558 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.015577:0:14503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a58605a00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043150.015582:0:14503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605a00/0x99260d7389c07558 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.015590:0:14503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605a00/0x99260d7389c07558 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.015605:0:14503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:1.0:1789043150.015608:0:14503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789043150.015621:0:14503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605a00/0x99260d7389c07558 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.015628:0:14503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605a00/0x99260d7389c07558 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.015660:0:14503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad800/0x99260d7389c074b0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.015668:0:14503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad800/0x99260d7389c074b0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.015674:0:14503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad800/0x99260d7389c074b0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.015689:0:14503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa069418ad800 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043150.015692:0:14503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad800/0x99260d7389c074b0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.015698:0:14503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad800/0x99260d7389c074b0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.015705:0:14503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa06a457d6d00) 00010000:00010000:1.0:1789043150.015708:0:14503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789043150.015714:0:14503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686000/0x99260d7389c074b7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e01 expref: 18 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.015725:0:14503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686000/0x99260d7389c074b7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e01 expref: 18 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.015735:0:14503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686000/0x99260d7389c074b7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e01 expref: 18 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.015788:0:14503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686000/0x99260d7389c074b7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.17@tcp remote: 0xea0b4a70ca676e01 expref: 18 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043150.015800:0:14503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f836300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14503:1875947267667072:192.168.203.17@tcp:105: 00000100:00100000:1.0:1789043150.015862:0:14503:0:(client.c:2716:ptlrpc_set_wait()) set ffffa06a41254900 going to sleep for 11 seconds 00000100:00100000:0.0:1789043150.020249:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:1.0:1789043150.020346:0:14503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f836300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14503:1875947267667072:192.168.203.17@tcp:105: 00010000:00010000:1.0:1789043150.020374:0:14503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad800/0x99260d7389c074b0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.020408:0:14503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa069418ad800/0x99260d7389c074b0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.020449:0:14503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c0755f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.020471:0:14503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c0755f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.020482:0:14503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c0755f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.020493:0:14503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c0755f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.020500:0:14503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c0755f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.020506:0:14503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c0755f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.020511:0:14503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686800 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043150.020554:0:14503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c0755f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.020562:0:14503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c0755f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.020573:0:14503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa06a457d6d00) 00010000:00010000:1.0:1789043150.020576:0:14503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789043150.020580:0:14503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c0755f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.020593:0:14503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a41686800/0x99260d7389c0755f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.020603:0:14503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605c00/0x99260d7389c07551 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.020609:0:14503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605c00/0x99260d7389c07551 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.020625:0:14503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605c00/0x99260d7389c07551 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.020630:0:14503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a58605c00 already unused, calling callback (ffffffffc1e7f4f0) 00010000:00010000:1.0:1789043150.020634:0:14503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605c00/0x99260d7389c07551 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.020640:0:14503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605c00/0x99260d7389c07551 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.020649:0:14503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa06a457d6d00) 00010000:00010000:1.0:1789043150.020651:0:14503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789043150.020655:0:14503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605c00/0x99260d7389c07551 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.020660:0:14503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a58605c00/0x99260d7389c07551 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043150.020871:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:58509587-cde8-42ed-8b49-4691b2633b0c+18:14509:x1875947242516224:12345-192.168.203.17@tcp:57:lhsmtool_posix.0 Request processed in 16676us (16861us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1789043150.020881:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 53 00000020:00080000:1.0:1789043150.020892:0:14503:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1789043150.021170:0:14504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242516480 00000100:00100000:3.0:1789043150.021179:0:14504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242516480 00000100:00100000:3.0:1789043150.021222:0:14504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 10 00000100:00100000:3.0:1789043150.021231:0:14504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa069412f1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58509587-cde8-42ed-8b49-4691b2633b0c+18:14507:x1875947242516480:12345-192.168.203.17@tcp:49:dd.0 00000100:00100000:3.0:1789043150.021336:0:14504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa069412f1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58509587-cde8-42ed-8b49-4691b2633b0c+18:14507:x1875947242516480:12345-192.168.203.17@tcp:49:dd.0 Request processed in 105us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043150.021342:0:14504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 10 00000040:00080000:0.0:1789043150.021636:0:14533:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789043150.021641:0:14533:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789043150.021666:0:14533:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789043150.021671:0:14533:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789043150.028595:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043150.028675:0:14504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242516736 00000100:00100000:3.0:1789043150.028685:0:14504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242516736 00000100:00100000:3.0:1789043150.028737:0:14504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 11 00000100:00100000:3.0:1789043150.028747:0:14504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58509587-cde8-42ed-8b49-4691b2633b0c+18:14509:x1875947242516736:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789043150.029426:0:14504:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789043150.029573:0:14504:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1789043150.029624:0:14504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28000/0x99260d7389c07566 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043150.029640:0:14504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28000/0x99260d7389c07566 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043150.029651:0:14504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28000/0x99260d7389c07566 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043150.029658:0:14504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28000/0x99260d7389c07566 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043150.029664:0:14504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28000/0x99260d7389c07566 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043150.029669:0:14504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28000/0x99260d7389c07566 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043150.029686:0:14504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789043150.029771:0:14504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:58509587-cde8-42ed-8b49-4691b2633b0c+20:14509:x1875947242516736:12345-192.168.203.17@tcp:35:lhsmtool_posix.0 Request processed in 1023us (1182us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1789043150.029780:0:14504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 11 00000020:00080000:3.0:1789043150.029786:0:14504:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789043150.030142:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789043150.030150:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28000/0x99260d7389c07566 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043150.030169:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc28000 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789043150.030173:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28000/0x99260d7389c07566 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043150.030181:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28000/0x99260d7389c07566 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043150.030193:0:14490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa06a44e19700) 00010000:00010000:0.0:1789043150.030196:0:14490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789043150.030200:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28000/0x99260d7389c07566 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043150.030206:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa06a6fc28000/0x99260d7389c07566 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043150.030221:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043150.030223:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789043150.030225:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789043150.184258:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043150.184315:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043150.184431:0:15192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242516864 00000100:00100000:0.0:1789043150.184448:0:15192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242516864 00000100:00100000:3.0:1789043150.184475:0:15191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242516992 00000100:00100000:3.0:1789043150.184486:0:15191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242516992 00000100:00080000:1.0:1789043150.184649:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789043150.184697:0:15192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 0 00000100:00100000:0.0:1789043150.184714:0:15192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f85dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:58509587-cde8-42ed-8b49-4691b2633b0c+8:2351:x1875947242516864:12345-192.168.203.17@tcp:4:dd.0 00002000:00010000:0.0:1789043150.184764:0:15192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aa2a1cd, atime: 0x6aa2a1cc, ctime: 0x6aa2a1cd, blocks: 0x1 00010000:00010000:0.0:1789043150.184773:0:15192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fbae420/0x99260d7389c0756d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043150.184789:0:15192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=493s v=(0 0) 00010000:00010000:0.0:1789043150.184793:0:15192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043150.184815:0:15192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fbae420/0x99260d7389c0756d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043150.184831:0:15192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fbae420/0x99260d7389c0756d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043150.186931:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043150.187710:0:15191:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789043150.187725:0:15191:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1789043150.188031:0:15191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242517120 00000100:00100000:3.0:1789043150.188043:0:15191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242517120 00000100:00100000:1.0:1789043150.189162:0:16727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 1 00000100:00100000:1.0:1789043150.189180:0:16727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f85c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:58509587-cde8-42ed-8b49-4691b2633b0c+10:2351:x1875947242516992:12345-192.168.203.17@tcp:4:dd.0 00010000:00010000:1.0:1789043150.189226:0:16727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094aae834/0x99260d7389c07574 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.189247:0:16727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789043150.189251:0:16727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789043150.189257:0:16727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094aae834/0x99260d7389c07574 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.189272:0:16727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094aae834/0x99260d7389c07574 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789043150.287632:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:3.0:1789043150.287659:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000001:00080000:3.0:1789043150.287667:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:3.0:1789043150.287676:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:1.0:1789043150.288044:0:15192:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:1.0:1789043150.288049:0:15192:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1789043149 -> 1789043150 00002000:00010000:1.0:1789043150.288052:0:15192:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:1.0:1789043150.288067:0:15192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fbae420/0x99260d7389c0756d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.288080:0:15192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fbae420/0x99260d7389c0756d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.288089:0:15192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fbae420/0x99260d7389c0756d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.288349:0:15192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa069418ad000 already unused, calling callback (ffffffffc1470760) 00010000:00010000:1.0:1789043150.288361:0:15192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fbae420/0x99260d7389c0756d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.288372:0:15192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fbae420/0x99260d7389c0756d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.288392:0:15192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fbae420/0x99260d7389c0756d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.288399:0:15192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fbae420/0x99260d7389c0756d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043150.288485:0:15192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f85dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:58509587-cde8-42ed-8b49-4691b2633b0c+10:2351:x1875947242516864:12345-192.168.203.17@tcp:4:dd.0 Request processed in 103773us (104238us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1789043150.288493:0:15192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 0 00000100:00100000:1.0:1789043150.288558:0:15192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 2 00000100:00100000:1.0:1789043150.288570:0:15192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:58509587-cde8-42ed-8b49-4691b2633b0c+9:2351:x1875947242517120:12345-192.168.203.17@tcp:4:dd.0 00010000:00010000:1.0:1789043150.288601:0:15192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c0757b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.288613:0:15192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789043150.288617:0:15192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789043150.288623:0:15192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c0757b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.288634:0:15192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c0757b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789043150.325810:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:1.0:1789043150.326681:0:16727:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:1.0:1789043150.326687:0:16727:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:1.0:1789043150.326701:0:16727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094aae834/0x99260d7389c07574 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.326714:0:16727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094aae834/0x99260d7389c07574 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.326722:0:16727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094aae834/0x99260d7389c07574 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.326729:0:16727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41686800 already unused, calling callback (ffffffffc1470760) 00010000:00010000:1.0:1789043150.326733:0:16727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094aae834/0x99260d7389c07574 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.326741:0:16727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094aae834/0x99260d7389c07574 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.326760:0:16727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094aae834/0x99260d7389c07574 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.326767:0:16727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094aae834/0x99260d7389c07574 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043150.326856:0:16727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f85c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:58509587-cde8-42ed-8b49-4691b2633b0c+9:2351:x1875947242516992:12345-192.168.203.17@tcp:4:dd.0 Request processed in 137677us (142536us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789043150.326879:0:16727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 1 00002000:00010000:0.0:1789043150.360842:0:15192:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:0.0:1789043150.360862:0:15192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c0757b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043150.360874:0:15192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c0757b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043150.360883:0:15192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c0757b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043150.360891:0:15192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a41687e00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:0.0:1789043150.360896:0:15192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c0757b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043150.360906:0:15192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c0757b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043150.360925:0:15192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c0757b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043150.360933:0:15192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003cfc4be1/0x99260d7389c0757b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043150.361066:0:15192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:58509587-cde8-42ed-8b49-4691b2633b0c+7:2351:x1875947242517120:12345-192.168.203.17@tcp:4:dd.0 Request processed in 72495us (174143us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1789043150.361076:0:15192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 2 00000001:00080000:2.0:1789043150.363610:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00000100:00100000:0.0:1789043150.369430:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043150.369480:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:2.0:1789043150.369621:0:15193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242517376 00000100:00100000:2.0:1789043150.369632:0:15193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242517376 00000100:00100000:2.0:1789043150.369700:0:15193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242517248 00000100:00100000:2.0:1789043150.369703:0:15193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242517248 00000100:00100000:2.0:1789043150.369732:0:15193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 3 00000100:00100000:2.0:1789043150.369742:0:15193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:58509587-cde8-42ed-8b49-4691b2633b0c+6:2351:x1875947242517376:12345-192.168.203.17@tcp:4:dd.0 00002000:00010000:2.0:1789043150.369790:0:15193:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6aa2a1ce, atime: 0x6aa2a1cc, ctime: 0x0, blocks: 0x1807 00010000:00010000:2.0:1789043150.369799:0:15193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6ca37b7/0x99260d7389c07582 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043150.369834:0:15193:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=493s v=(0 0) 00010000:00010000:2.0:1789043150.369839:0:15193:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789043150.369845:0:15193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6ca37b7/0x99260d7389c07582 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043150.369861:0:15193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6ca37b7/0x99260d7389c07582 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043150.370145:0:15192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 4 00000100:00100000:0.0:1789043150.370155:0:15192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:58509587-cde8-42ed-8b49-4691b2633b0c+7:2351:x1875947242517248:12345-192.168.203.17@tcp:4:dd.0 00010000:00010000:0.0:1789043150.370172:0:15192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fbae420/0x99260d7389c07589 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043150.370182:0:15192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043150.370186:0:15192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789043150.370191:0:15192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fbae420/0x99260d7389c07589 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789043150.370201:0:15192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fbae420/0x99260d7389c07589 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789043150.375262:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043150.375295:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:0.0:1789043150.375342:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.17@tcp (source: 12345-192.168.203.17@tcp) 00000100:00100000:3.0:1789043150.375414:0:15191:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1789043150.375425:0:15191:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:1.0:1789043150.375813:0:16727:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1789043150.375822:0:16727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242517504 00000100:00100000:1.0:1789043150.375831:0:16727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242517504 00000100:00100000:1.0:1789043150.375880:0:16727:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1789043150.375887:0:16727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242517632 00000100:00100000:1.0:1789043150.375890:0:16727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242517632 00000100:00100000:1.0:1789043150.375901:0:16727:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1789043150.375905:0:16727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947242517760 00000100:00100000:1.0:1789043150.375907:0:16727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947242517760 00000100:00100000:3.0:1789043150.376560:0:16729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 5 00000100:00100000:3.0:1789043150.376574:0:16729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:58509587-cde8-42ed-8b49-4691b2633b0c+11:2352:x1875947242517504:12345-192.168.203.17@tcp:4:dd.0 00010000:00010000:3.0:1789043150.376609:0:16729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000711b9d83/0x99260d7389c07590 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043150.376629:0:16729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789043150.376633:0:16729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789043150.376639:0:16729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000711b9d83/0x99260d7389c07590 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043150.376652:0:16729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000711b9d83/0x99260d7389c07590 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.460004:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789043150.488731:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:2.0:1789043150.493562:0:15193:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 6291456 00002000:00010000:2.0:1789043150.493572:0:15193:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1789043150 00002000:00010000:2.0:1789043150.493575:0:15193:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 12295 00010000:00010000:2.0:1789043150.493590:0:15193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6ca37b7/0x99260d7389c07582 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043150.493604:0:15193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6ca37b7/0x99260d7389c07582 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043150.493614:0:15193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6ca37b7/0x99260d7389c07582 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043150.493622:0:15193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a58604a00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:2.0:1789043150.493627:0:15193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6ca37b7/0x99260d7389c07582 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043150.493638:0:15193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6ca37b7/0x99260d7389c07582 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043150.493681:0:15193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6ca37b7/0x99260d7389c07582 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043150.493691:0:15193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6ca37b7/0x99260d7389c07582 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043150.493835:0:15193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:58509587-cde8-42ed-8b49-4691b2633b0c+15:2351:x1875947242517376:12345-192.168.203.17@tcp:4:dd.0 Request processed in 124087us (124407us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1789043150.493846:0:15193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 3 00000100:00100000:2.0:1789043150.493886:0:15193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 6 00000100:00100000:2.0:1789043150.493899:0:15193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:58509587-cde8-42ed-8b49-4691b2633b0c+14:2352:x1875947242517632:12345-192.168.203.17@tcp:4:dd.0 00010000:00010000:2.0:1789043150.493931:0:15193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059efe46d/0x99260d7389c07597 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043150.493944:0:15193:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789043150.493949:0:15193:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789043150.493954:0:15193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059efe46d/0x99260d7389c07597 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043150.493966:0:15193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059efe46d/0x99260d7389c07597 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789043150.543910:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00000001:00080000:1.0:1789043150.543954:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:2.0:1789043150.544279:0:16729:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00010000:00010000:2.0:1789043150.544296:0:16729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000711b9d83/0x99260d7389c07590 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043150.544332:0:16729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000711b9d83/0x99260d7389c07590 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043150.544341:0:16729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000711b9d83/0x99260d7389c07590 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043150.544349:0:16729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a6fc29600 already unused, calling callback (ffffffffc1470760) 00010000:00010000:2.0:1789043150.544353:0:16729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000711b9d83/0x99260d7389c07590 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043150.544364:0:16729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000711b9d83/0x99260d7389c07590 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043150.544384:0:16729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000711b9d83/0x99260d7389c07590 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043150.544392:0:16729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000711b9d83/0x99260d7389c07590 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789043150.544498:0:16729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:58509587-cde8-42ed-8b49-4691b2633b0c+12:2352:x1875947242517504:12345-192.168.203.17@tcp:4:dd.0 Request processed in 167922us (169239us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1789043150.544508:0:16729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 5 00000100:00100000:2.0:1789043150.544571:0:16729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.17@tcp, seq: 7 00000100:00100000:2.0:1789043150.544584:0:16729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:58509587-cde8-42ed-8b49-4691b2633b0c+11:2352:x1875947242517760:12345-192.168.203.17@tcp:4:dd.0 00010000:00010000:2.0:1789043150.544618:0:16729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6ca37b7/0x99260d7389c0759e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043150.544637:0:16729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789043150.544641:0:16729:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789043150.544647:0:16729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6ca37b7/0x99260d7389c0759e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789043150.544658:0:16729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6ca37b7/0x99260d7389c0759e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043150.545578:0:15192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fbae420/0x99260d7389c07589 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043150.545592:0:15192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fbae420/0x99260d7389c07589 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043150.545600:0:15192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fbae420/0x99260d7389c07589 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043150.545607:0:15192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa069418ad000 already unused, calling callback (ffffffffc1470760) 00010000:00010000:3.0:1789043150.545610:0:15192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fbae420/0x99260d7389c07589 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043150.545633:0:15192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fbae420/0x99260d7389c07589 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043150.545649:0:15192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fbae420/0x99260d7389c07589 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043150.545657:0:15192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fbae420/0x99260d7389c07589 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043150.545800:0:15192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:58509587-cde8-42ed-8b49-4691b2633b0c+11:2351:x1875947242517248:12345-192.168.203.17@tcp:4:dd.0 Request processed in 175643us (176316us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1789043150.545810:0:15192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 4 00000001:00080000:2.0:1789043150.586990:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:1.0:1789043150.590697:0:15193:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:1.0:1789043150.590707:0:15193:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:1.0:1789043150.590723:0:15193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059efe46d/0x99260d7389c07597 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.590737:0:15193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059efe46d/0x99260d7389c07597 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.590747:0:15193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059efe46d/0x99260d7389c07597 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.590755:0:15193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a58605e00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:1.0:1789043150.590760:0:15193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059efe46d/0x99260d7389c07597 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.590791:0:15193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059efe46d/0x99260d7389c07597 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.590812:0:15193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059efe46d/0x99260d7389c07597 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789043150.590820:0:15193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059efe46d/0x99260d7389c07597 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789043150.591076:0:15193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:58509587-cde8-42ed-8b49-4691b2633b0c+9:2352:x1875947242517632:12345-192.168.203.17@tcp:4:dd.0 Request processed in 97177us (215774us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1789043150.591087:0:15193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 6 00000001:00080000:2.0:1789043150.614087:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:3.0:1789043150.614446:0:16729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6ca37b7/0x99260d7389c0759e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043150.614597:0:16729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6ca37b7/0x99260d7389c0759e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043150.614607:0:16729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6ca37b7/0x99260d7389c0759e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043150.614615:0:16729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa06a58604a00 already unused, calling callback (ffffffffc1470760) 00010000:00010000:3.0:1789043150.614620:0:16729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6ca37b7/0x99260d7389c0759e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043150.614648:0:16729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6ca37b7/0x99260d7389c0759e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043150.614670:0:16729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6ca37b7/0x99260d7389c0759e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789043150.614678:0:16729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6ca37b7/0x99260d7389c0759e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789043150.614778:0:16729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:58509587-cde8-42ed-8b49-4691b2633b0c+5:2352:x1875947242517760:12345-192.168.203.17@tcp:4:dd.0 Request processed in 70193us (239431us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1789043150.614787:0:16729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.17@tcp, seq: 7 00000100:00100000:0.0:1789043151.091673:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff892c07-94a8-4144-ae30-5a70a83d490b:3314:1875947267667200:0@lo:400:kworker.0 00000100:00100000:0.0:1789043151.091877:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043151.091933:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267667712:0@lo:400:kworker.0 00000100:00100000:0.0:1789043151.091993:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043151.092020:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789043151.092027:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267667328:0@lo:400:kworker.0 00000100:00100000:1.0:1789043151.092255:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267667200 00000100:00100000:1.0:1789043151.092264:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267667200 00000100:00100000:1.0:1789043151.092313:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789043151.092323:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a52449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+19:3314:x1875947267667200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789043151.092373:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a52449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff892c07-94a8-4144-ae30-5a70a83d490b+19:3314:x1875947267667200:12345-0@lo:400:kworker.0 Request processed in 52us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043151.092380:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789043151.092418:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267667712 00000100:00100000:1.0:1789043151.092421:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267667712 00000100:00100000:1.0:1789043151.092458:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789043151.092465:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267667712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789043151.092497:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875947267667712:12345-0@lo:400:kworker.0 Request processed in 34us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789043151.092855:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1789043151.092884:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789043151.092916:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875947267667584:0@lo:400:kworker.0 00000100:00100000:1.0:1789043151.092945:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043151.092966:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789043151.092985:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267667456:0@lo:400:kworker.0 00000100:00100000:1.0:1789043151.093011:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789043151.093063:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267667584 00000100:00100000:3.0:1789043151.093069:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267667584 00000100:00100000:3.0:1789043151.093104:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789043151.093111:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875947267667584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789043151.093152:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875947267667584:12345-0@lo:400:kworker.0 Request processed in 41us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043151.093158:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789043151.093177:0:16375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267667456 00000100:00100000:3.0:1789043151.093181:0:16375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267667456 00000100:00100000:3.0:1789043151.093214:0:16375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789043151.093220:0:16375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267667456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789043151.093314:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875947267667584:0@lo:400:kworker.0 00000100:00100000:1.0:1789043151.093380:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789043151.093387:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267667968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789043151.093563:0:16375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267667456:12345-0@lo:400:kworker.0 Request processed in 342us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043151.093583:0:16375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1789043151.093600:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789043151.103160:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043151.103280:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa06a7f837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875947267667840:0@lo:400:kworker.0 00000100:00100000:0.0:1789043151.103318:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789043151.103365:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff892c07-94a8-4144-ae30-5a70a83d490b:3314:1875947267667200:0@lo:400:kworker.0 00000100:00100000:0.0:1789043151.103380:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875947267667712:0@lo:400:kworker.0 00000100:00100000:3.0:1789043151.103741:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267667840 00000100:00100000:3.0:1789043151.103750:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267667840 00000100:00100000:3.0:1789043151.103861:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789043151.103872:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a6f33aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875947267667840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789043151.103928:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a6f33aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875947267667840:12345-0@lo:400:kworker.0 Request processed in 58us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043151.103936:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789043151.104028:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267667328 00000100:00100000:2.0:1789043151.104033:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267667328 00000100:00080000:0.0:1789043151.104072:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789043151.104077:0:14497:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789043151.104100:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875947267667840:0@lo:400:kworker.0 00000100:00100000:2.0:1789043151.104204:0:15188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789043151.104212:0:15188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a763c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267667328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789043151.104255:0:15188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a763c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875947267667328:12345-0@lo:400:kworker.0 Request processed in 43us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1789043151.104261:0:15188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789043151.104367:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875947267667328:0@lo:400:kworker.0 00000100:00100000:1.0:1789043151.104380:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789043151.104468:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1789043151.104474:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa06a75edc000, transno 8589934595 00000004:00080000:1.0:1789043151.104494:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1789043151.104532:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267667456:0@lo:400:kworker.0 00000100:00100000:3.0:1789043151.110606:0:15189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875947267667968 00000100:00100000:3.0:1789043151.110619:0:15189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875947267667968 00000100:00100000:3.0:1789043151.110686:0:15189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789043151.110818:0:15189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa06a7f837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267667968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789043151.110847:0:15189:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3859808256 avail 3849322496 00000100:00100000:3.0:1789043151.110937:0:15189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa06a7f837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875947267667968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 242us (6558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789043151.110945:0:15189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789043151.111078:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa06a7f834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875947267667968:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789043151.479698:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789043152.158071:0:16766:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1789043152.499014:0:14489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29761 lines, 29761 kept, 0 dropped, 0 bad.